Steady state thermodynamics 

Shin-ichi S and Hal Tasaki 3 

The present paper reports our attempt to search for a new universal frame- 
work in nonequilibrium physics. We propose a thermodynamic formalism that 
is expected to apply to a large class of nonequilibrium steady states including a 
heat conducting fluid, a sheared fluid, and an electrically conducting fluid. We 
call our theory steady state thermodynamics (SST) after Oono and Paniconi's 
original proposal. The construction of SST is based on a careful examination of 
how the basic notions in thermodynamics should be modified in nonequilibrium 
steady states. We define all thermodynamic quantities through operational 
procedures which can be (in principle) realized experimentally. Based on SST 
thus constructed, we make some nontrivial predictions, including an extension 
of Einstein's formula on density fluctuation, an extension of the minimum work 
principle, the existence of a new osmotic pressure of a purely nonequilibrium 
origin, and a shift of coexistence temperature. All these predictions may be 
checked experimentally to test SST for its quantitative validity. 
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1 Introduction 

1.1 Motivation and the goal of the paper 

Construction of statistical mechanics that applies to nonequilibrium states has been a chal- 
lenging open problem in theoretical physics. By statistical mechanics, we mean a universal 
theoretical framework that enables one to precisely characterize states of a given system, 
and to compute (in principle) arbitrary macroscopic quantities. Nobody knows what the 
desired nonequilibrium statistical mechanics should look like. Indeed it seems highly un- 
likely that there is statistical mechanics that applies to any nonequilibrium systems. A 
much more modest (but still extremely ambitious) goal is to look for a theory that applies 
to nonequilibrium steady states, which are out of equilibrium but have no macroscopically 
observable time dependence. There may be a chance that probability distributions for 
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nonequilibrium steady states can be obtained from a general principle, analogous to the 
equilibrium statistical mechanics. Our ultimate goal is to find such a principle, but the 
goal (if any) is still very far away. 

We wish to recall the history of equilibrium statistical mechanics. When Boltzmann, 
Gibbs, and others constructed statistical mechanics, the formalism of thermodynamics 
played a fundamental role as a theoretical guide. In particular, Gibbs seems to have 
intentionally sought for a probability distribution which most naturally recovers some of 
the thermodynamic relations. 

In our attempt toward nonequilibrium statistical mechanics, we too would like to start 
from the level of phenomenology and look for a possible thermodynamics. By a thermo- 
dynamics, we mean a rigid mathematical structure consisting of mathematical relations 
among certain quantities in a physical system. The mathematical structure of thermo- 
dynamics is clearly and abstractly explained, for example, in P3I21E1- The conventional 
thermodynamics for equilibrium systems is a typical and no doubt the most important 
example of thermodynamics, but it is not the only example (see, for example, section 3 of 
and Appendix 1. Al of @]). 

Then it makes sense to look for a thermodynamics in a physical context other than 
equilibrium systems. We wish to do that for nonequilibrium steady states. If it turns 
out that there is no sensible thermodynamics for nonequilibrium steady states, then we 
should give up seeking for statistical mechanics. If there is a thermodynamics, on the 
other hand, then we can start looking for statistical mechanics which is consistent with 
the thermodynamics. Our goal in the present paper is to propose a thermodynamics for 
nonequilibrium steady states, and to convince the readers that our proposal is essentially 
the unique possible thermodynamics. 



The standard theory of nonequilibrium thermodynamics (see section 1.3.1(d)| ) is based 



on the local equilibrium hypothesis, which roughly asserts that each small part of a 
nonequilibrium state can be regarded as a copy of a suitable equilibrium state. But 
such a description seems insufficient for general nonequilibrium steady states, especially 
when the "degree of nonequilibrium" is not small. 

Consider, for example, a system with steady heat flow. It is true that quantities like 
the temperature and the density become essentially constant within a sufficiently small 
portion of the system. But no matter how small the portion is, there always exists a 
heat flux passing through it and hence the local state is not isotropic. It is quite likely 
that the pressure tensor, for example, becomes anisotropic, and the equation of state is 
consequently modified. Then the local state cannot be identical to an equilibrium state, 
but should be described rather as a local steady state. 

There has been some attempts to formulate thermodynamics for nonequilibrium steady 
states by going beyond local equilibrium treatments. See section 11.3.51 Among these at- 
tempts, we regard the steady state thermodynamics (SST) proposed by Oono and Paniconi 
j2] to be most sophisticated and promising. The basic strategy of Oono and Paniconi is to 
seek for a universal thermodynamic formalism respecting general mathematical structure 
of thermodynamics and operational definability of thermodynamic quantities. As far as 
we know, no other proposals of nonequilibrium thermodynamics follow such logically strict 
rules. Oono and Paniconi's SST, however, is still too abstract to be tested empirically. 
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In the present paper, we follow the basic strategy of Oono and Paniconi's, but try to 
construct much more concrete theory which leads to nontrivial predictions. Our strategy 
in the present work may be summarized as follows. 

• Concentrate on some typical examples (i.e., a heat conducting fluid, a sheared fluid, 
and an electrically conducting fluid) of nonequilibrium steady states, always trying 
to elucidate universal aspects of the problem. 

• Examine carefully how the basic notions of thermodynamics (for example, scaling, 
extensivity/intensivity, and operations to systems) should be modified in nonequi- 
librium steady states. 

• Define every thermodynamic quantity through a purely operational procedure which 
can be realized experimentally. 

• Make concrete predictions which may be checked experimentally to test our theory 
for its quantitative validity. 

As a result, our theory has no direct logical connection with Oono and Paniconi's SST. 
But we keep the name SST to indicate that we share the basic philosophy with them. 

Our theory is of course based on some phenomenological assumptions, the biggest 
one being the assumption that there exists a sensible thermodynamics. Although we are 
confident about theoretical consistency of our SST, its validity must ultimately be tested 
empirically. 

If we restrict ourselves to certain idealized (but still nontrivial) theoretical models, we 
can demonstrate that the formalism of SST is indeed realized. We shall present such model 
dependent results as Appendices. The most complete "existence proof" is the results in 
Appendix [B] about the driven lattice gas, a standard stochastic model for nonequilibrium 
steady states. For a sheared fluid with a "weak coupling", we also recover a significant 
part (but, not the whole) of SST as we describe in Appendix IA1 

Of course we have no intention to claim that our SST should cover nonequilibrium 
states in general. Systems with explicit macroscopic time-dependence are out of consid- 
eration from the beginning. Systems which are too unstable to maintain stable thermo- 
dynamics cannot be treated. Moreover, since we make a full use of the pressure, model 
systems (such as chains of oscillators) which do not possess well-defined pressure do not fit 
into our scheme. We nevertheless hope that our formalism covers a generic and nontrivial 
class of nonequilibrium steady states. 

The organization of this long paper may easily be read off from the table of contents. 
After discussing necessary materials from equilibrium physics in section |2J we carefully 
describe our assumptions, and construct steady state thermodynamics step by step through 
sections El to To help the readers, the beginning of each of these sections contains a 
brief summary of the section. 

Before going into this massive main body, the reader is invited to take a look at the 
next section fOl where we offer a very quick tour of our construction and predictions. In 
addition, we compare our approach with some of the existing attempts in section fOl dis- 
cuss possible experimental verifications in section IH^l and answer some of the "frequently 
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asked questions" in section 18.31 Appendices, which treat model dependent results, may 
be studied independently after reading the introductory section rOl 

We should better stress here that the present paper does not report a standard scien- 
tific research in which one provides answers to well established problems. We report our 
(admittedly ambitious) attempt to search for a novel universal framework that describes 
Nature. We thus take a nonstandard approach where we proceed step by step, stating 
each assumption carefully, examining its consistency, and discussing the consequences. We 
have tried our best to make the presentation as transparent as possible, not hiding any 
subtle points. 

1.2 A quick look at steady state thermodynamics (SST) 

To give the reader a rough idea about what our steady state thermodynamics is all about, 
we shall here outline (rather superficially) our construction and predictions in a single 
example of a sheared fluid. Every step illustrated here will be examined and explained 
carefully in latter sections of the paper. In particular we will thoroughly discuss in the 
latter sections why we believe that the present construction is essentially the unique way 
toward a sensible thermodynamics for nonequilibrium steady states. 

1.2.1 Nonequilibrium steady state in a sheared fluid 

Suppose that N moles of fluid is contained in a box with the cross section area A and 
height h, and kept at a constant temperature T with the aid of an external heat bath. 
To make the state nonequilibrium, the upper wall of the box is moved horizontally with 
a constant speed T while the lower wall is kept at rest 4 . We suppose that the walls are 
"sticky", and the fluid will reach, after a sufficiently long time, a nonequilibrium steady 
state with a velocity gradient as in Fig. (a). We denote by r the total horizontal force 
that the upper wall exerts on the fluid. The steadiness implies that the lower wall exerts 
exactly the opposite force on the fluid. Clearly the shear force r measures the "degree of 
nonequilibrium" of the steady state. 

We shall parameterize the nonequilibrium steady state as (T, r; V, N) where V = Ah 
is the volume. As in the equilibrium thermodynamics (see section 12.1)) . we frequently 
consider scaling, decomposition, and combination of steady states. In doing so, we always 
use the convention to fix the cross section area A constant, and vary only the height h. 

In this convention of scaling, T and r are identified as intensive variables, while V 
and iV as extensive variables. These identifications are fundamental in our construction 
of SST. 

We stress that the above convention of scaling and the choice of thermodynamic vari- 
ables are results of very careful examination of general structures of thermodynamics and 
the characters specific to nonequilibrium steady states. These points are discussed in 
sections E3 and EJ 

4 It is convenient to imagine that periodic boundary conditions are imposed in the horizontal directions. 
Experimentally, one should modify the geometry (say, into a ring shape) to keep on moving the wall. 
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(a) r (b) (c) 



T 




4 

Figure 1: (a) The nonequilibrium steady states of a sheared fluid. The velocity 
gradient is maintained by shear forces exerted on the fluid by the upper and the 
lower walls. The two walls exert exactly the opposite forces, whose magnitudes are 
r, on the fluid. The steady state is parameterized as (T, r; V, N). (b) The pressure is 
determined by measuring the vertical mechanical force exerted on the wall, (c) The 
chemical potential is determined by adding external potential to the system. 



1.2.2 Pressure and chemical potential 

We now fix the two intensive parameters T and r, and determine the pressure p(p) and 
the chemical potential p(p) as functions of the density p = V/N. We insist on determining 
these quantities in a purely operational manner, only using procedures that can be realized 
experimentally. This is the topic of section |S| 

The pressure p(p) is simply defined as the mechanical pressure on the lower or the 
upper wall as in Fig. ^ (b). In other words we concentrate on the vertical component of 
the pressure. 

The measurement of the chemical potential p(p) requires extra cares. We (fictitiously) 
divide the system into half along a horizontal plane, and apply a potential which is equal 
to Mi in the lower half and equal to u<i in the upper half. We denote by p\ and p 2 the 
densities in the lower and the upper parts, respectively, in the steady state under the 
potential. We shall define the SST chemical potential p(p) as a function which satisfies 

PiPl) + U! = p(p 2 ) + U 2 , (1.1) 

for any U\ and u 2 . 

Note that this only determines the difference of p(p). There remains a freedom to add 
an arbitrary constant to «(p). In other words, we have determined the V, N dependence 
of the chemical potential, but not T, v dependence. 

An essential point of these definitions is that the Maxwell relation 

MP) _ M 9 N 

dp ~ p dp [ ' 

can be shown to hold in general. 

1.2.3 Helmholtz free energy 

Since we have determined the pressure and the chemical potential, we can introduce and 
investigate the SST free energy. This is done in section |BJ We define the specific free 
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(a) 



(b) 



Figure 2: Two basic applications of the SST free energy F(T, r; V, N). (a) We 
conjecture that Einstein's formula for density fluctuation extends to nonequilibrium 
steady states, provided that the two regions are separated by a wall with a window 
in it. (b) The minimum work principle is conjectured to hold when the agent is only 
allowed to move horizontal walls vertically. 




energy through the Euler equation as 

f(p)=-p(p)+ P M- (1-3) 

The extensive free energy is obtained as F(T, r; V, N) = V f(N/V). We have thus opera- 
tionally determined the V, N dependence of F(T, r; V, N) for each T and r. 

We make three predictions which involve the V, N dependence of the free energy. 
The first two of these phenomenological conjectures can be verified by making plausible 
assumption about contact, as we shall see in Appendix |XJ In a class of stochastic processes 
treated in Appendix |Bl all the three conjectures are derived. 

The first prediction is an extension of Einstein's formula on macroscopic density fluc- 
tuation. Consider the steady state (T, r; 2V, 2N) with 2N moles of fluid in a box with 
volume 2V. We divide the system into two identical parts with volumes V by a horizon- 
tal wall with a small window 5 in it as in Fig. El (a). We fix the wall in the middle, and 
apply the same shear force r to the upper and the lower walls to maintain the constant 
shear in the whole system. In this way the two parts are coupled weakly and exchange 
fluid molecules. Let N\ and N 2 be the amounts of fluid in the lower and the upper parts, 
respectively. Although both N\ and N 2 should be equal to N in the average, one always 
observes a fluctuation in a finite system. Our conjecture is that the probability p(Ni, N 2 ) 
of observing Ni and N 2 moles of fluid in the two parts is given by 

p(N u N 2 ) oc exp[--^-{F(T, r; V, + F(T, r; V, N 2 )}), (1.4) 

where k-Q is the Boltzmann constant. Unlike the corresponding relation in equilibrium, 
this relation is expected to hold only when the two regions are separated by the horizontal 
wall with a window. 

The second prediction is the fluctuation-response relation for time-dependent processes 
that takes place in the same setting as above. We shall leave details to sections 16.21 1 A. 41 
and El 

5 See Appendix 1X1 for details about the window. 



8 



(a) 



(b) 



Figure 3: (a) A nonequilibrium steady state with a finite shear is in contact with an 
equilibrium state without a shear. The two states are separated by a porous wall that 
allows fluid to pass thorough. The top wall and the porous wall are at rest while the 
bottom wall has a constant horizontal velocity. This setup is used to determine the 
chemical potential and the free energy completely. SST leads to a conjecture that the 
(vertical) pressure in the steady state is always larger than that in the equilibrium 
state, (b) A nonequilibrium steady state with a phase coexistence. We conjecture 
that the coexistence temperature T c (p,r) deviates from that in the equilibrium. 

The third prediction is an extension of the minimum work principle, a version of the 
second law of thermodynamics. Suppose that an outside agent moves one of the horizontal 
walls of the box vertically, always keeping the wall horizontal as in Fig. El (b) . We assume 
that T and r are kept constant during the operation. We denote by V and V the initial 
and the final volumes, respectively. Denoting by W the total mechanical work done by the 
agent, we can write the conjectured minimum work principle for nonequilibrium steady 
states as 

W > F(T, r; V, N) - F(T, r- V, N), (1.5) 

which has exactly the same form as the corresponding equilibrium relation. An essential 
difference is that we here severely restrict allowed operations. 

1.2.4 Flux-induced osmosis and shift of coexistence temperature 

We shall now determine the SST free energy F(T, r; V, N) completely and make further 
conjectures. This is the topic of section 

The key idea is to consider the setting in Fig. El (a), where a nonequilibrium steady 
state (T, r; V, N) with a finite shear is in contact with an equilibrium state (T, 0; V, N') 
via a porous wall. Since the two states can exchange fluid, we require that 

f i(T,T;V,N)= f i(T,0 ] V',N') (1.6) 

as in equilibrium thermodynamics. Since /x(T, 0; V, N') is an already known equilibrium 
quantity, we use (|1.6|) as the definition of the SST chemical potential. 

Now that the chemical potential has been fully determined, we can also determine the 
SST free energy F(T, r; V, N) through (jl.3|) . including its dependence on T and r. Then 
we can define the SST entropy 

S(T, r; V, N) = - JU(T, r; V, N), (1.7) 
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and a new extensive quantity 



*(T, r; ^ iV) = ~F{T, r; V, iV). (1.8) 

We call \P(T, r; V, N) the nonequilibrium order parameter, since we can show (under the as- 
sumption about concavity of F(T, r; V, N) in r) that 0; V, JV) = and *(T, r; V, AT) = 
-tf(T,-r; V,iV) > if r > 0. 

The nonequilibrium order parameter \I/(T, r; V, N) characterizes two important phe- 
nomena, which are intrinsic to nonequilibrium steady states. 

The first phenomenon takes place in the setting of Fig. El (a). Suppose one fixes the 
pressure p eq of the equilibrium part, and changes the shear force r. Then we can show 
that the pressure p ss of the steady state satisfies 

dp ss *(T,t;V,N) 

~d7 v • (L9) 

Sine p ss = p eq when r = 0, this (and the knowledge about the sign of implies that 
Pss > Peq in general. We expect that p ss > p e q holds for r ^ 0. The steady state always 
has a higher pressure than the equilibrium state. We call this pressure difference the flux- 
induced osmosis (FIO). Note that FIO can never be predicted within the standard local 
equilibrium treatments. 

To see the second phenomenon, suppose that two phases (such as gas and liquid) 
coexist within a steady state as in Fig. |3] (b). We denote by T c (p, r) the temperature at 
which the coexistence takes place when the pressure and the shear force are fixed at p and 
r, respectively. We can then show that 



dT c (p,r) 



dr S g — Si 



(1.10) 



where S gt £ and are the entropy and the nonequilibrium order parameter in the gas and 
the liquid phases, respectively. This means that in general the coexistence temperature 
T c (p, t) in a nonequilibrium steady state is different from that in equilibrium. This, again, 
is a truly nonequilibrium phenomenon. Applied to the phase coexistence between a fluid 
and a solid phases, the same argument yields T c (p, r) < T c (p, 0). Thus the shear induces 
melting. 

It is important that the same quantity \& plays the essential roles in the above two 
phenomena. This means that we can test the quantitative validity of SST through purely 
experimental studies. 



1.3 Existing approaches to nonequilibrium steady states 

In the present section, we briefly discuss some of the existing approaches to nonequilibrium 
steady states, and see how they are (or how they are not) related to our own approach 
of SST. We note that the aim here is not to give an exhaustive and balanced review of 
the field, but to place our new work in the context of (necessarily biased) summary of 
nonequilibrium thermodynamics and statistical mechanics. 
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1.3.1 Phenomenological theories in the linear nonequilibrium regime 

Probably the best point to start this discussion on nonequilibrium physics is Einstein's 
celebrated work on the Brownian motion. We have no intention of going deeply into the 
work, but wish to mention that Einstein's formula 

D = k B Tfi, (1.11) 

derived in [5J E] represents a deep fact that the transport coefficient (the mobility ji) 
in a driven nonequilibrium state is directly related to the diffusion constant D, which 
characterizes fluctuation in the equilibrium state. 

(a) Onsager's theory: Such a relation between equilibrium fluctuation and nonequilibrium 
transport was stated as a fundamental principle of (linear) nonequilibrium physics by 
Onsager. In his famous paper on the reciprocal relations [7] , he formulated the regression 
hypothesis which asserts that "the average regression of fluctuations (in equilibrium) will 
obey the same laws as the corresponding macroscopic irreversible processes" |3J. From the 
regression hypothesis and microscopic reversibility of underlying mechanics, Onsager [7J |H] 
derived the reciprocal relations for transport coefficients. Since the reciprocal relations are 
established experimentally, this provides a strong support to the regression hypothesis, at 
least in the linear nonequilibrium regime. It is fair to say that, as far as nonequilibrium 
steady states in linear transport regime are concerned, Onsager constructed a beautiful 
phenomenology with sound theoretical and empirical bases. 

Onsager's theory is essentially related to (at least) three subsequent developments in 
nonequilibrium physics that we shall discuss in the following. 

(b) Linear response relations: A series of formulae that express various transport coeffi- 
cients in terms of time-dependent equilibrium correlation functions was found in various 
contexts, the first example being that by Nyquist 0, who precedes Onsager. These for- 
mulae are now known under the generic name linear response relations. See, for example, 
[TIH IUJ • We believe that the conceptual basis of these relations should be sought in a 
certain form of regression hypothesis, i.e., quantitative correspondence between nonequi- 
librium transport and equilibrium fluctuation. 

(c) Variational principles: The second development is the establishment of variational 
principles which relate currents to the corresponding forces in the linear response regime. 
The simplest version of such principles, called the principle of the least dissipation of 
energy, is obtained as a direct consequence of the reciprocal relations 0IB]- Another type 
of variational principle attempting to characterize nonequilibrium steady states is called 
the principle of minimum entropy production 12 . It is understood that all the correct 
variational principles in linear transport regime are based on the Onsager-Machlup theory 
fUlEJE] which concerns a large deviation functional for the history of fluctuations. See, 
for example, fXH]|. 

(d) Nonequilibrium thermodynamics: Flux-force relations with the reciprocity constitute 
fundamental ingredients of the standard theory known as nonequilibrium thermodynam- 
ics, which provides a macroscopic description of a system which slightly deviates from 
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equilibrium ^21 EI- A fundamental assumption in this approach is that a small portion of 
the system in the nonequilibrium state can be regarded as a local equilibrium state in the 
sense that all the thermodynamic relations in equilibrium (not only universal relations, but 
also equations of states specific to each system) are valid without modifications. One then 
allows macroscopic thermodynamic variables to vary slowly in space and time, assuming 
that there takes place linear transport according to a given set of transport coefficients. 

(e) Relation to SST: We wish to see how our SST is related to these theories. In short, we 
see no direct logical connection for the moment. All of these theories are essentially limited 
to linear transport regime with very small "degree of nonequilibrium", while SST is de- 
signed to apply to any nonequilibrium steady states. The variational principles mentioned 
above attempt to characterize the steady state itself, while the SST free energy mainly 
describes the response of nonequilibrium steady states to external operations (such as the 
change of the volume) under a fixed degree of nonequilibrium. We can say that, at least for 
the moment, SST covers aspects complimentary to that dealt with the above theories. It 
would be very interesting to incorporate Onsager's and related phenomenology into SST, 
but we do not yet see how this can be accomplished. 

We have already stressed in section 11.11 the difference between the nonequilibrium 
thermodynamics and our SST. Our main motivation is to construct thermodynamics that 
applies to systems very far from equilibrium. We must abandon the description in terms 
of local equilibrium states, and replace it with that in terms of local steady states 6 . 

1.3.2 Approaches from microscopic dynamics 

It is a natural idea to realize and characterize nonequilibrium steady states by using equi- 
librium states and microscopic (classical or quantum) dynamics. Suppose that we are 
interested in a heat conducting steady state. We prepare an arbitrary (macroscopic) sub- 
system, and couple it to two "heat baths" which are much larger than the subsystem. 
The two heat baths are initially in thermal equilibria with different temperatures. We 
then let the whole system evolve according to the microscopic equation of motion. After a 
sufficiently long (but not too long) time, the subsystem is expected to reach a steady heat 
conducting state. By projecting only onto the subsystem, we get the desired nonequilib- 
rium steady state. If such a projection can be executed for general systems, there is a 
chance that we can extract a universal description for nonequilibrium steady states. 

Of course the procedure described above is in general too difficult to be carried out 
literally even in the linear response regime. We shall see two approximate calculation 
schemes within the conventional statistical mechanics (which are (a) and (b)), and some 
of more mathematical approaches (which are (c), (d), and (e)). 

If and when these theories provide us with concrete information about the structure 
of nonequilibrium steady states and their response to external operations, we can (and 
should) check the consistency between such predictions and those obtained from SST. For 
the moment most of the known results are rather formal, and we do not find any concrete 
results which should be compared with SST. 

6 It should be noted that, in the present work, we are concentrating on characterizing local steady 
states, and not yet considering spatial and temporal variation of macroscopic variables. It is among our 
future plan to patch together local steady states to describe non-uniform nonequilibrium states. 
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(a) Linear response theory: Probably the most well-known of such schemes is the linear 
response theory ^DIE]- Although this theory is sometimes referred to as a "microscopic 
(or rigorous) derivation" of linear response relations (see, for example, |lUj). it is after 
all a formal perturbation theory about the equilibrium state, and does not deal with the 
intrinsic characterization of nonequilibrium steady states. As far as we understand, certain 
phenomenological principle must be invoked to justify such a derivation. 

(b) Methods based on the Liouville equation: In classical mechanics, the Liouville equation 
can be a starting point for microscopic considerations. An example is the derivation of the 
non-linear response relation of [TH], which leads to the Kawasaki- Gunton formula JH] for a 
nonlinear shear viscosity and normal stresses. Another example is the establishment of the 
existence of long range spatial correlations of fluctuations in nonequilibrium steady states 
[2*U] . These results were obtained by employing the projection operator method pioneered 
by Zwanzig [21] and Mori (22,. Furthermore, through a formal argument based on the 
Liouville equation, McLennan [2H] and Zubarev [21] proposed a measure that describes 
(or is claimed to describe) nonequilibrium states. 

Although the derivations of these results involve (often uncontrolled) assumptions, the 
nonlinear response relation, the Kawasaki- Gunton formula, and the power-law decay of 
spatial correlations are believed to be physically sound, since they can also be derived in 
simple manners from phenomenological considerations. See [22] for the nonlinear response 
relation, [21] for the Kawasaki-Gunton formula, and [20] for the long range correlations. 
The measure proposed by McLennan and Zubarev is supported by neither a controlled 
theory nor a phenomenological argument. It is therefore difficult to judge its physical 
validity and usefulness. 

(c) Weak coupling limit: In the weak coupling limit of quantum systems, the procedure 
of projection can be executed rigorously [21] ■ Relaxation to the steady state, the recip- 
rocal relations in linear transport, and the principle of minimum entropy production are 
established. In this study, however, explicit forms of nonequilibrium steady states are not 
obtained. 

(d) C* algebraic approaches: There is a series of works in which heat baths are modeled 
by infinitely large systems of ideal gases, and the time evolution is discussed by using 
the C* algebraic formalism. See, for example, |2B]. As far as we understand, the results 
obtained in this direction mainly focus on what happens when more than two baths are 
put into contact, rather than what happens in the subsystem where transport is taking 
place. We still do not get much information about the structure of nonequilibrium steady 
states from these works. 

(e) Chain of anharmonic oscillators: A standard model for heat conduction in classical 
mechanics is the chain of coupled anharmonic oscillators whose two ends are attached to 
two heat baths with different temperatures. From numerical simulations (see, for example, 
[2H]) it is expected that the model exhibits a "healthy" heat conduction, i.e., obeys the 
Fourier law. Mathematically, basic results including the existence, uniqueness and mixing 
property of the nonequilibrium steady states are proved under suitable conditions [30] EH], 
but no concrete information about the structure of the heat conducting state is available. 
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Recently a new perturbative method for the nonequilibrium steady state of this model 
was developed [32] . 

1.3.3 Approaches from meso-scale models 

We turn to approaches to nonequilibrium steady states that employ a class of models which 
are neither microscopic (as in mechanical treatments) nor macroscopic (as in thermody- 
namic treatments). The class, which may be called mesoscopic, includes the Boltzmann 
equation, the nonlinear Langevin equations for slowly varying macroscopic variables, and 
the driven lattice gas. 

(a) Boltzmann equation: The method developed by Chapman and Enskog [33] enables 
one to explicitly compute perturbative solutions of the Boltzmann equation. Expecting 
that the Boltzmann equation, which was originally introduced to describe relaxation to 
equilibrium, may be extended to study nonequilibrium phenomena 7 , nonequilibrium sta- 
tionary distribution functions have been calculated. Recently, for example, a systematic 
calculation for heat conducting nonequilibrium steady states was performed [3J3 EH] • Such 
a study reveals detailed properties of the nonequilibrium steady states, and may become 
an important guide in construction of phenomenology and statistical mechanical theory. 
The relation of this result to SST will be discussed in section 17.41 As for recent progress 
in this direction, see references in [3J)J EE] ■ 

(b) Nonlinear Langevin model for macroscopic variables: Nonlinear Langevin models for 
macroscopic variables were useful to study anomalous behavior of transportation coeffi- 
cients at the critical point [37]. The shift of the critical temperature under the influence 
of shear flow as well as the corresponding critical exponents were calculated by analyzing 
the so called model H with the steady shear flow [38J. 

Such an approach might produce correct results for universal quantities (such as the 
critical exponents) which are insensitive to minor details of models. It is questionable, 
however, whether a non-universal quantity like the critical temperature shift can be prop- 
erly dealt with. Results from a model calculation may be always improved by making the 
model more and more complicated, but such a process of improvement seems endless. If the 
formulation of SST is true, on the other hand, the shift of coexistence temperatures should 
be related to other measurable quantities through the (conjectured) extended Clapeyron 
law, which is expected to be universal 8 . 

(c) Driven lattice gas: Given the history that the lattice gas models (equivalently, the 
Ising model) was the paradigm model in the study of equilibrium phase transitions, it 
is natural that various stochastic models of lattice gases for nonequilibrium states were 

7 The Boltzmann equation can be derived from the BBGKY hierarchy in a low density limit around the 
(spatially uniform) equilibrium state. (See |H4j for the mathematical justification of the derivation.) We 
have to keep in mind, however, that there is a logical possibility that correction terms to the Boltzmann 
equation appear in the truncation process from the BBGKY hierarchy when the spatial non-uniformity 
of the states are taken into account. 

8 Needless to say, thermodynamic phases may be in principle determined from microscopic descriptions 
when and if statistical mechanics for nonequilibrium steady states is constructed. 
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studied. See, for example, (HH]- The simplicity of these models made it possible to resolve 
some delicate issues rigorously, a notable examples being the long-range correlations j3U] 
and the anomalous current fluctuation |4*T] . 

A standard nontrivial model is the driven lattice gas j32] , in which particles on lattice 
are subject to hard core on-site repulsion, nearest neighbor interaction, and a constant 
driving force. Many results, both theoretical and numerical, have been obtained |3lH 143j . 
but the structure of the nonequilibrium steady state is still not very well understood 
except for some partial results including the recent perturbation expansion jH]. In 
hydrodynamic limit and fluctuation was studied for the nonequilibrium steady state in 
the driven lattice gas. Possibility of thermodynamics of driven lattice gas being "shape- 
dependent" was pointed out in In SST, such a shape-dependence is properly taken 
into account in the basic formalism. 

For us the driven lattice gas provides a very nice "proving ground" for various proposals 
and conjectures of SST. Some of our discussions in the present paper are based on earlier 
numerical works by Hayashi and Sasa in In Appendix[B]of the present paper, we also 
discuss theoretical results about SST realized in driven lattice gases. 

In spite of all these interesting works, we always have to keep in mind that physical 
basis of these stochastic lattice models are still unclear. As for the stochastic dynamics 
near equilibrium, it is well appreciated that the detailed balance condition (which was 
indeed pointed out in Onsager's work on the reciprocal relations [7]) is the necessary and 
sufficient condition to make the model physically meaningful. As for dynamics far away 
from equilibrium, we still do not know of any criteria that should replace the detailed 
balance condition. 

1.3.4 Recent progress 

In the last decade, there have been some progress in new directions of study on nonequi- 
librium steady states. They are fluctuation theorem, additivity principle, and dynamical 
fluctuation theory. We shall briefly review them and comment on the relevance to SST. 

(a) Fluctuation theorem: In a class of chaotic dynamical systems, a highly nontrivial 
symmetry in the entropy production rate, now known by the name fluctuation theorem, 
was found (3H1I1H]- The fluctuation theorem was then extended to nonequilibrium steady 
states in various systems. See [5TH I5H 152]. 

Now it is understood that the essence of the fluctuation theorem lies in the fact that 
the relevant nonequilibrium steady states are described by Gibbs measures for space-time 
configurations jS2]- It is known that nonequilibrium steady states that are modeled by 
a class of chaotic dynamical system jl] or by a class of stochastic processes |HD E3j are 
described by space-time Gibbs measures. But it is not yet clear if the description in terms 
of a space-time Gibbs measure is universally valid. 

A more important question is whether a space-time description is really necessary for 
nonequilibrium steady states. One might argue that any nonequilibrium physics should be 
described in space-time language, since the time-evolution must play a crucial role. On the 
other hand, one may also expect that the temporal axis is redundant for the description 
of nonequilibrium steady states since nothing depends on time. 
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Our formalism of SST is based on the assumption that one can construct a consistent 
macroscopic phenomenology without explicitly dealing with the temporal axis. If a space- 
time description is mandatory for nonequilibrium physics, our attempt should reveal its 
own failure as we pursue it. So far we have encountered no inconsistencies. 

(b) Additivity principle: Recently Derrida, Lebowitz, and Speer obtained exact large de- 
viation functionals for the density profiles in the nonequilibrium steady states of the one 
dimensional lattice gas models (the symmetric exclusion process 153] and the asym- 
metric exclusion process [23 E7J) attached to two particle baths with different chemical 
potentials. In the equilibrium states, the corresponding large deviation functional coincides 
with the thermodynamic free energy. Moreover their large deviation functional satisfies a 
very suggestive variational principle named additivity principle. It was further proposed 

that, in a large class of one dimensional models, the large deviation functional for 
current satisfies a similar additivity principle. 

It would be quite interesting if these large deviation functionals could be related to 
the SST free energy that we construct operationally. Unfortunately we still do not see 
any explicit relations. A difficulty comes from the restriction to one dimensional lattice 
systems, where it is not easy to realize macroscopic operations which are essential in our 
construction. It is thus of great interest whether the additivity principles can be extended 
to higher dimensions. 

(c) Dynamical fluctuation theory: Bertini, De Sole, Gabrielli, Jona-Lasinio, and Landim 
EDI re-derived the above mentioned large deviation functional by analyzing the model 

of fluctuating hydrodynamics. In [SHI EDI, the large deviation functional of the density 
profile is obtained through the history minimizing an action functional for spontaneous 
creation of a fluctuation. When one is concerned with equilibrium dynamics, which has the 
detailed balance property, such a task can be accomplished essentially within the Onsager- 
Machlup theory 14: . In nonequilibrium dynamics, where the detailed balance condition is 
explicitly violated, a modified version of the Onsager-Machlup theory had to be devised to 
derive a closed equation 9 for the large deviation functional (HHl US] • By using the equation, 
the possible form of the evolution of fluctuations was determined, and a generalized type 
of fluctuation dissipation relation for nonequilibrium steady states was proposed. 

In j^ni EH] > the form of fluctuating hydrodynamics must be assumed or derived from 
other microscopic models. We believe that the SST free energy, if it really exists, should be 
taken into account in this step. It would be quite interesting if the fluctuation dissipation 
relation that they proposed is related to the generalized second law of our SST. 

1.3.5 Thermodynamics beyond local equilibrium hypothesis 

There of course have been a number of attempts to formulate nonequilibrium thermody- 
namics that goes beyond local equilibrium treatment 10 . A considerable amount of works 

9 Unfortunately, it is likely that the equations for the large deviation functional can be solved exactly 
only in special cases, the model treated by Derrida, Lebowitz, and Speer being an example. 

10 Landauer |61M62| made a deep criticism to thermodynamics and statistical mechanics for nonequilib- 
rium states in general. He argued, correctly, that one cannot expect to fully characterize a nonequilibrium 
state by simply minimizing a local function of states like the energy or the free energy. The main point of 
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appear under the name extended irreversible thermodynamics [o^H 164j . 

In extended irreversible thermodynamics, thermodynamic functions with extra vari- 
ables for the "degree of nonequilibrium" are considered, and thermodynamic relations are 
discussed for various systems. This is quite similar to what we shall do in our own SST. 

As far as we have understood, however, the philosophies behind extended irreversible 
thermodynamics and our SST are very much different. In the literature of extended ir- 
reversible thermodynamics, we do not find anything corresponding to our careful (and 
lengthy) discussions about the convention of scaling, the identification of intensive and 
extensive variables, the (almost) unique choice of nonequilibrium variables, the fully op- 
erational construction of the free energy, or the proof of Maxwell relation. We also notice 
that, in many works in the extended irreversible thermodynamics, different levels of ap- 
proaches, such as macroscopic phenomenology, microscopic kinetic theory, and statistical 
mechanics (such as the maximum entropy method) are discussed simultaneously. In our 
own approach to SST, in contrast, we have tried to completely separate thermodynamics 
from microscopic considerations, stressing what outcome we get (and we do not get) from 
purely macroscopic phenomenology. 

Although it is impossible to examine all the existing literature, it is very likely that 
more or less the same comments apply to other approaches in similar spirit. Examples 
include [531 HUH E7J ■ 

To make the comparison more concrete, let us take a look at two examples. 

The same problem of sheared fluid that we have briefly seen in section 11.21 is treated, 
for example, in jHHl 69J. Although the final conclusion ^\ that shear induces melting 
is the same, everything else is just different. The discussion in |UH1 lo^j are essentially 
model dependent, while we try to derive universal thermodynamic relations. Moreover 
the proposed thermodynamics in |68t EH] uses the shear velocity F (more precisely the 
shear rate 7 — T/h where h is the distance between the upper and the lower walls) as 
the nonequilibrium variable. But one of our major conclusions in the present work is 
that a thermodynamics with the variable V (or 7) has a pathological behavior. Thus the 
analysis of EHI can never be consistent with our SST. Indeed it is our opinion that the 
introduction of the nonequilibrium entropy in (7Uj, which gives a foundation to the above 
works, is not well-founded. Analysis of sheared fluids in [7TJ [72] looks sounder to us, but 
still does not contain careful steps as in SST. 

In |73] the pressure in a heat conducting state is discussed. This again is in a sharp 
contrast between our own discussion of a similar problem. The work in [73] is based on 
a formula of the Shannon entropy obtained from microscopic theories (kinetic theory and 
the maximum entropy calculation). We see no reason that the Shannon entropy gives 
meaningful thermodynamic entropy once the system is away from equilibrium. Opera- 
tional meaning of the pressure is also unclear. A gedanken experiment is proposed, but 

his argument is that a coupling between two different subsystems can be much more delicate and trickier 
than we are used to in equilibrium physics. 

We can assure that our SST is perfectly safe from Landauer's criticism. First of all, we ourselves have 
encountered the delicateness of variational principle in nonequilibrium steady states, and this observation 
led us to the (almost) unique choice of nonequilibrium thermodynamic variables. This point will be 
discussed in section Delicateness of contact is another issue that we ourselves have realized (with 
a surprise) during the development of SST. In section 17.51 we shall argue that the contact between an 
equilibrium state and a nonequilibrium steady state may be very delicate. 
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there seems to be no way of realizing this setting (even in principle) unless one precisely 
knows in advance the formula for the nonequilibrium pressure. Our discussion, in contrast, 
starts from a completely operational definition of the pressure. We also predict a shift of 
pressure due to nonequilibrium effects in section 17.41 but as a universal thermodynamic 
relation. Let us note in passing that the maximum entropy calculation (called information 
theory), on which [73] and other related works rely (see also [Hj), is found to produce 
results which are inconsistent with the Boltzmann equation [3o] . 

To conclude, our SST is completely different in essentially all the aspects from the 
extended irreversible thermodynamics and other similar approaches. The only similarity 
is in superficial formalism, i.e., thermodynamic functions with extra variables. It is our 
belief that our own approach achieves much higher standard of logical rigor, and has a 
better chance of providing truly powerful and correct description of nature. 

2 Brief review of equilibrium physics 

Before dealing with nonequilibrium problems, we present a very brief summary of ther- 
modynamics (section |2.1|) . statistical mechanics ( section l2.2j) . and approaches based on 
stochastic processes ( section |2~3|) for equilibrium systems. The main purpose of the present 
section is to fix some notations and terminologies used throughout the paper, to give some 
necessary background, and, most importantly, to motivate our approach to steady state 
thermodynamics (SST). 

2.1 Equilibrium thermodynamics 

Equilibrium thermodynamics is a universal theoretical framework which applies exactly to 
arbitrary macroscopic systems in equilibrium. 

Here we restrict ourselves to the formalism of equilibrium thermodynamics at a fixed 
temperature, since it is directly related to our approach to steady state thermodynamics. 
See, for example, [75] for relations between different formalisms of thermodynamics 11 . 

2.1.1 Equilibrium states and operations 

A fluid consisting of a single substance of amount 12 N is contained in a container with 
volume V and kept in an environment with a fixed temperature T. If we leave the system 
in this situation for a sufficiently long time, it reaches an equilibrium state, where no 
observable macroscopic changes take place. An equilibrium state of this system is known 
to be uniquely characterized (at least in the macroscopic scale) by the three macroscopic 
parameters T, V, and N. We can therefore denote the equilibrium state symbolically as 
(T; V, N). Note that we have separated the intensive variable T and the extensive variables 
V, N by a semicolon. This convention will be used throughout the present paper. 

n The most beautiful formalism of thermodynamics uses energy variable instead of temperature. See, 
for example, 

12 The amount of substance N is sometimes called the "molar number" since N is usually measured in 
moles. 
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In thermodynamics, various operations to equilibrium states play essential roles. Let 
us review them briefly. 

By gently inserting a thin wall into an equilibrium state, one can decompose the state 
into two separate equilibrium states. This is symbolically denoted as 

(T; V, N) - (T; V u N{j + (T; V 2 , N 2 ), (2.1) 

where 13 Vi + V 2 — V and Ni + N 2 = N. One may realize the inverse of this operation 
by attaching the two equilibrium states together and removing the wall between them. 
Another important operation is to put two or more equilibrium states together, separating 
them by walls which do not pass fluids but are thermally conducting. In this way we get 
an equilibrium state characterized by a single temperature T and more than one pairs of 

(y,n). 

Given an arbitrary A > 0, one can associate with an equilibrium state (T; V, N) its 
scaled copy as 

(T; V, N) — > (T; XV, XN). (2.2) 

The scaled copy has exactly the same properties as the original state, but its size has been 
scaled. 

The intensive variable T and the extensive variables V, N show completely different 
behaviors under the operations ()2.1|) and (j2.2j) . One may roughly interpret that an inten- 
sive variable characterizes a certain property of the environment of the system, while an 
extensive variable measures an amount of the system. 



2.1.2 Helmholtz free energy 

The Helmholtz free energy (hereafter abbreviated as "free energy") F(T; V, N) is a spe- 
cial thermodynamic function which carries essentially all the information regarding the 
equilibrium state (T; V, N). 

The free energy F(T; V, N) is concave in the intensive variable T, and is jointly convex 14 
in the extensive variables V and N. Corresponding to the decomposition (|2.1|) . it satisfies 
the additivity 

F(T; V, N) = F(T; V u N x ) + F(T; V 2 , N 2 ), (2.3) 
and corresponding to the scaling (|2.2j) . the extensivity 

F(T;XV,XN) = XF(T;V,N). (2.4) 

The free energy F(T; V, N) appears in the second law of thermodynamics in the form 
of the minimum work principle. Consider an arbitrary mechanical operation to the system 
executed by an external (mechanical) agent, a typical (and important) example being a 
change of volume caused by the motion of a wall. We assume that the system is initially in 
the equilibrium state (T; V, N), and the operation is done in an environment with a fixed 

13 Note that Vi, V2, Ni, N2 in the right-hand side are not arbitrary. If one fixes (for example) Vi, V2, 
then Ni, N2 are determined almost uniquely. 

14 A function g(V, N) is jointly convex in (V, N) if 5 (AVi + (1 - X)V 2 , XNi + (1 - X)N 2 ) < Ap(Fi,iVi) + 
(1 - X)g(V 2 , N 2 ) for any Vi, V 2 , N u N 2 , and < A < 1. 
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temperature T. Sufficiently long time after the operation, the system will settle down to 
another equilibrium state (T;V',N). Let W be the total mechanical work done by the 
agent during the whole operation. Then the minimum work principle asserts that the 
inequality 

W > F(T; V', N) — F(T; V, N) (2.5) 

holds for an arbitrary operation. Note that the operation need not be gentle or slow. 

Another important physical relation involving the free energy is the following formula 
about fluctuation in equilibrium. Suppose that we have two systems of the same volume 
V which are in a weak contact with each other which allows fluid to move from one system 
to another slowly. If the total amount of fluid is 2N, the amount of substance in each 
subsystem should be equal to iV in average. But there always is a small fluctuation in 
the amount of substance. Let p(N 1 ,N 2 ) be the probability density that the amounts of 
substance in the two subsystems are N\ and N 2 . Then it is known that in equilibrium this 
probability behaves as 



p(Ni, N 2 ) oc exp 



' {F(T;V,Ni) + F(T;V,N2)} 



(2.6) 



where k-Q is the Boltzmann constant. This is the isothermal version of Einstein's celebrated 
formula of fluctuation. See, for example, chapter XII of [To] . 

2.1.3 Variational principles and other quantities 

Let V\, V 2 , Ni, and N 2 be those in the decomposition (j2.1|) . Then from the extensivity 
()2.4)1 and the convexity of F(T; V, N), one can show the variational relation 15 

F(T;V 1 ,N 1 )+F(T;V 2 ,N 2 )= min {F(T; V[, Ni) + F(T; V 2 , N 2 )}, (2.7) 

which corresponds to the situation in which the system is divided by a movable wall into 
two parts with fixed amounts Ni and N 2 of fluids. The volumes V[ and V 2 of the two parts 
can vary within the constraint V[ + V 2 = V, and finally settle to the equilibrium values 
Vi and V 2 , respectively. If we define the pressure by 

^v^jjmm, ( ,s) 

the variational relation ()2.7)1 leads to the condition 

p(T;V 1 ,N 1 )=p(T;V 2 ,N 2 ), (2.9) 

which expresses the mechanical balance between the two subsystems (that have volumes 
V\ and V 2 , respectively). This thermodynamic pressure coincides with the pressure defined 
in a purely mechanical manner 16 . 

15 The derivation is standard, but let us describe it for completeness. Let TV = TVi + and A = Ni/N, 
and take arbitrary V{, V{ with V[ + V£ = V. Then from the extensivity l|2.4(l and the convexity (see 
footnote HI, we get F(T;V{,Ni) + F(T;V^,N 2 ) = XF(T;V{/X,N) + (1 - A) F(T; F 2 '/(l - A), N) > 
F(T; V, N). With the additivity (|2.3|l . this implies a variational principle l|2.7jl . 

16 More precisely, the free energy is defined so that to ensure this coincidence. 
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One can derive the similar variational relation 



F(T; Vx, Aq) + F(T; V 2 , N 2 ) = min {F(T; V u N[) + F(T\ V 2 , Nfi}, (2.10) 

(N[+N^=N) 

for the situation where the system is divided into two parts with fixed volumes V%, V 2 , and 
the amounts N[ and N' 2 in the two parts may vary within the constraint N[ + N' 2 — N . 
This leads to another balance condition 

p(T;V 1 ,N 1 ) = p(T;V 2 ,N 2 ), (2.11) 

where 

, (T ,y, N) ^l^Ml (, 12) 

is the chemical potential. 

To get a better insight about the chemical potential, and to motivate our main defini- 
tion of the chemical potential for SST (see section I5T2J1 . suppose that we apply a potential 
which is equal to U\ in the subsystem with volume V\ and is equal to u 2 in that with 
volume V 2 . Since the addition of a uniform potential u simply changes the free energy 
F(T] V, N) to F(T; V, N) + uN , the variational relation in this case becomes 

F(T] Vi, Ni) + U\N\ + F(T; V 2 , N 2 ) + u 2 N 2 

= min {FiT^N^+mNi + FiT^N^+u^}. (2.13) 

(N[+N' 2 =N) 

Then the corresponding balance condition becomes 

/i(T; V x , Aq) + Ul = /x(T; V 2 , N 2 ) + u 2 (2.14) 

which clearly shows that /x(T; V, N) is a kind of potential 17 . 

These examples illustrate a very important role played by intensive quantities in ther- 
modynamics, which role will be crucial to our construction of SST. Suppose in general 
that one has an extensive variable (V or N in the present case) in the parameterization 
of states. Also suppose that two states are in touch with each other, and each of them 
are allowed to change this extensive variable under the constraint (like V{ + V 2 — V or 
N[ + N 2 = N) that the sum of the extensive variables is fixed. Then there exists an inten- 
sive quantity (like p or p) which is conjugate to the extensive variable in question, and the 
condition for the two states to balance with each other is represented by the equality (like 
(J2.9I) or (|2.1ip ) of the intensive quantity. The product of the original extensive variable 
and the conjugate intensive variable always has the dimension of energy. 

Finally we write down some of the useful relations which involve the pressure and 
the chemical potential. From the extensivity (j2.4j) of the free energy, one gets the Euler 
equation 

F(T;V,N) = -Vp(T;V,N) + Np(T;V,N). (2.15) 

17 Note that fj,(T;V,N) is here defined by (|2.12(l . It is also useful to consider the "electrochemical 
potential" fi u (T; V, N) = p(T; V, N) + u, but we do not use it here. 



21 



From the definitions ()2.8|) and (|2.12|) . one gets 

dp(T; V, N) dp(T; V, N) 
ON ~ dV ' 



(2.16) 



which is one of the Maxwell relations. Since the pressure and the chemical potential 
are intensive 18 , one may define p(T,p) = p(T;l,N/V) = p(T;V,N) and p(T,p) = 
H(T; 1, N/V) = /i(T; V, N) with p = N/V. Then the Maxwell relation (EHfil) becomes 

dp(T,p) _ dp(T,p) 

dp ~ p dp ■ 10 

2.2 Statistical mechanics 

Suppose that we are able to describe a macroscopic physical system using a microscopic 
dynamics 19 . Let S be the set of all possible microscopic states of the system. For simplicity 
we assume that S is a finite set. The system is characterized by the Hamiltonian H(-), 
which is a real valued function on S. For a state s G S, H(s) represents its energy. 

The essential assertion of equilibrium statistical mechanics is that macroscopic prop- 
erties of an equilibrium state can be reproduced by certain probabilistic models. An 
important example of such probabilistic models is the canonical distribution in which the 
probability of finding the system in a state s G S is given by 

e -f3H{s) 

*,<«) = - m -, (2-18) 
where j3 = {k^T)~ l is the inverse temperature, and 

Z(f3) = J2 e ~ /3H(s) ( 2 - 19 ) 
ses 

is the partition function. Moreover if we define the free energy as 

F((3) = -^logZ(i3), (2.20) 

it satisfies all the static properties of the free energy in thermodynamics, including the 
convexity, and the variation properties. 

The formula (|2.6J) about density fluctuation holds automatically in the canonical for- 
malism. Let us see the derivation. Consider a system describing a fluid, and denote 
by Sn the state space when there are iV molecules in the system. We define Z^{(3) = 
J2 s &s N e -/3H ( s ) and F(fi,N) = — (1/(3) \ogZ N (P). Consider a new system obtained by 
weakly coupling two identical copies of the above system, and suppose that the total num- 
ber of molecules is fixed to 2N. Then the probability of finding a pair of states (s, s') with 
s e S Nl , s' G S N2 , and JVi + iV 2 = 2N is 

f3{H{s)+H(s')} 

^ s '> = z tM ) ' (2 ' 21) 



18 p{T; XV, XN) = p{T; V, N) and n(T; XV, XN) = n(T; V, N) for any A > 0. 

19 Thc description may not be ultimately microscopic. A necessary requirement is that one can write 



down a reasonable microscopic Hamiltonian. 
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where Z to t(P) is the partition function of the whole system. Then the probability p(Ni, N 2 ) 
of finding Ni and N 2 molecules in the first and the second systems, respectively, is 

p(N 1 ,N 2 ) = ^q( s ' s ') 
seS Nl 

s'€Sn 2 

Z Ni ((3)ZnM 

= expi-PiF&^ + F&NJ-FutiP)}], (2.22) 
which is nothing but the desired formula (|2.fi|) . 

2.3 Markov processes 

Although statistical mechanics reproduces static aspects of thermodynamics, it does not 
deal with dynamic properties such as the approach to equilibrium and the second law. 
To investigate these points from microscopic (deterministic) dynamics is indeed a very 
difficult problem, whose understanding is still poor. For some of the known results, see, 
for example, [77J [7HI [75] . If we become less ambitious and start from effective stochastic 
models, then we have rather satisfactory understanding of these points. 

2.3.1 Definition of a general Markov process 

Again let S be the set of all microscopic states in a physical system. A Markov process on 
S is defined by specifying transition rates c(s — > s') > for all s ^ s' G S. The transition 
rate c(s —>■ s') is the rate (i.e., the probability divided by the time span) that the system 
changes its state from s to s'. 

Let pt(s) be the probability distribution at time t. Then its time evolution is governed 
by the master equation, 

j f Pt(s) = {" c ( s - s ') + < s ' - s ) ( 2 - 23 ) 

s'es 

for any s G S. 

A Markov process is said to be ergodic if all the states are "connected" by nonvan- 
ishing transition rates 20 . In an ergodic Markov process, it is known that the probability 
distribution pt(s) with an arbitrary initial condition converges to a unique stationary dis- 
tribution Poo(s) > 0. Then from the master equation ()2.23j) . one finds that the stationary 
distribution is characterized by the equation 

J2 {-c(s -> s') Poo (s) +c(s' -> s) Poo (s')} = 0, (2.24) 
s'es 

for any sGiS. See, for example, [5U] . 

20 More precisely, for any s, s' G 5, one can find a finite sequence si,S2, . . . , s n € S such that si = s, 
s n = s', and c(sj —> Sj+i) ^ for any j = 1, 2, . . . , n — 1. 
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2.3.2 Detailed balance condition 



The convergence to a unique stationary distribution suggests that, if one wishes to model a 
dynamics around equilibrium, one should build a model so that the stationary distribution 
Poo(s) coincides with the canonical distribution p C q(s) of (j2.18j) . A sufficient (but far from 
being necessary) condition for this to be the case is that the transition rates satisfy 

C(S -» s')Peq(s) = c(s' -» s) p cq (s') (2.25) 

for an arbitrary pair s / s' G 5. By substituting ()2.25|) into (j2.24j) . one finds that each 
summand vanishes and ()2.24|) is indeed satisfied with Poo(s) = p eq (s). The equality (j2.25|) 
is called the detailed balance condition with respect to the distribution p eq {s). 

Today one always assumes the detailed balance condition (|2.25|) when studying dy- 
namics around equilibrium using a Markov process. This convention is based on a deep 
reason, which was originally pointed out by Onsager [3 IE], that sucn models automatically 
satisfy macroscopic symmetry known as "reciprocity." See section 1.3.1(a)} 



By substituting the formula (J2.18)) of the canonical distribution into the condition 
(I2.25|) . it is rewritten as 

^ff^r = exp[(3{H(s) - H(s>)}\, (2.26) 
c{s' — > s) 

for any s ^ s' such that c(s — > s f ) ^ 0. Usually the condition ()2.26|) is also called the 
detailed balance condition. A standard example of transition rates satisfying ()2.26|) is 

c (s _> s ') = a (s, s') 4>{P{H{s') - H(s)}), (2.27) 

where a(s, s') = a(s', s) > are arbitrary weights which ensure the ergodicity 21 , and (f>(h) 
is a function which satisfies 

<P(h) =e- h <f)(-h), (2.28) 

for any h. The standard choices of (fi(h) are i) the exponential rule with 4>{h) = e~ h ^ 2 , 
ii) the heat bath (or Kawasaki) rule with <p(h) = (1 + e and iii) the Metropolis rule 
with <p(h) = 1 if h < and 4>(h) = e~ h if h > 0. In equilibrium dynamics, these (and other) 
rules can be used rather arbitrarily depending on one's taste. But it has been realized 
these days |%T] I4"4"j that the choice of rule crucially modifies the nature of the stationary 
state if one considers nonequilibrium dynamics. Indeed we will see a drastic example in 
section IB. 81 in the Appendix. 



2.3.3 The second law 

To study the minimum work principle ()2.5|) . we must theoretically formulate mechanical 
operations by an outside agent. When the agent moves a wall of the container, she 
is essentially changing the potential energy profile for the fluid molecules. We therefore 

21 A simple choice is to set a(s, s') = 1 if s' can be "directly reached" from s, and a(s, s') — otherwise. 
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consider a Hamiltonian H^ a '(s) with an additional control parameter a, and let c^ a '(s — * s') 
be transition rates whose stationary distribution is the canonical distribution 22 

p£?00 = ^i^exp[-/?#M(s)]. (2.29) 

Suppose that the agent changes this parameter according to a prefixed (arbitrary) 
function 23 a(t) with < t < if. (tf is the time at which the operation ends.) Since 
the Hamiltonian H^ a ^(s) is now time-dependent, the transition rates c^ a ^(s — > s') also 
become time-dependent. 

To mimic the situation in thermodynamics, we assume that, at time t = 0, the 
probability distribution coincides with the equilibrium state for a = a(0), i.e., we set 
Po(s) = Peq (s). The probability distribution pt(s) for < t < t{ is the solution of the 
time-dependent master equation 

j t Pt{s) = Yl {- c{a(t)) ( s - s')p t (s) + c^\s> - s)p t (s% (2.30) 
s'es 

which is simply obtained by substituting the time-dependent transition rates into the 
master equation ()2.23|) . Let us denote the average over the distribution pt(s) as 

(g(s)) t = J29(s)p t (s), (2.31) 

where g(s) is an arbitrary function on S. 

Now, in a general time-dependent Markov process, a theorem sometimes called the 
"second law" is known 24 . We shall describe it carefully in the Appendix Q The theorem 
readily applies to the present situation, where the key quantity defined in ()C.2j) becomes 



with 



<pW{a) = -logpg'00 =(3{H (a) (s) -F(P,a)}, (2.32) 

F((3,a) = -h gJ2exp[-(3H^(s)} (2.33) 

" ses 

being the free energy with the parameter a. Then the basic inequality (|C.5J) implies that, 
for any differentiable function a(t), one has 



at \ da 



>F(J3,a(tt))-F(l3,a(p)). (2.34) 

a=a(t) I t 



Let us claim that the left-hand side of ()2.34j) is precisely the total mechanical work 
done by the external agent. Consider a change from time t to t + At, where At is small. 

22 As an example, one replaces H(s) in (|2.27l) with H^(s). 

23 Here we are not including any feedback from the system to the agent. (The agent does what she had 
decided to do, whatever the reaction of the system is.) To include the effects of feedback seems to be a 
highly nontrivial problem. 

24 According to |82| . such a theorem was first proved by Yosida. See XIII-3 of |83| . 
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Figure 4: The upper and the lower walls have temperatures T\ ow and T^gh, respec- 
tively. In the nonequilibrium steady state, the fluid in the container carries a steady 
heat current in the vertical direction. We assume that there is no convection. 



The change of the Hamiltonian is AH(s) = H a( - t+At \s) — H a ^(s). Since the agent directly 
modifies the Hamiltonian, the work done by the agent between t and t + At is equal to 25 
(AH(s)) t + 0((At) 2 ). By summing this up (and letting At — > 0), we get the left-hand 
side of ()2.34|) . With this interpretation, the general inequality ()2.34|) is nothing but the 
minimum work principle (J2.5j) . 



3 Nonequilibrium steady states and local steady states 

Equilibrium thermodynamics, equilibrium statistical mechanics, and Markov process de- 
scription of equilibrium dynamics, which we reviewed briefly in section El are universal 
theoretical frameworks that apply to equilibrium states of arbitrary macroscopic physical 
systems. As we have discussed in section [TTTJ our goal in the present paper is to construct 
such a universal thermodynamics that applies to nonequilibrium steady states. 

In the present section, we shall make clear the class of systems that we study, and 
describe their nonequilibrium steady states ( section l3.1|) . We then discuss the important 
notion of local steady state (section EHJ). 

3.1 Nonequilibrium steady states 

A macroscopic physical system is in a nonequilibrium steady state if it shows no macro- 
scopically observable changes while constantly exchanging energy with the environment. 

Although our aim is to construct a universally applicable theory, it is useful (or even 
necessary) to work in concrete settings. Let us describe typical examples that we shall 
study in the present paper. 

3.1.1 Heat conduction 

The first example is heat conduction in a fluid. Suppose that a fluid consisting of a single 
substance is contained in a cylindrical container as in Fig. 0] The upper and the lower 

25 Note that this is different from (ff«( t + At ) (s)) Ai - (#" (t) (s)) f . The difference is nothing but the 
energy exchanged as "heat." 
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Figure 5: There is a fluid between two "sticky" horizontal walls. The upper wall 
moves with a constant speed V while the lower wall is at rest. In the nonequilibrium 
steady state, the fluid develops a velocity gradient. The forces that the upper and 
the lower walls exert on fluid are exactly opposite with each other. 



walls of the cylinder are kept at constant temperatures T low and T high , respectively, with 
the aid of external heat baths. The side walls of the container are perfectly adiabatic. 

If the system is kept in this setting for a sufficiently long time, it will finally reach a 
steady state without any macroscopically observable changes. We assume that convection 
does not take place, so there is no net flow in the fluid. But there is a constant heat 
current from the lower wall to the upper wall, which constantly carries energy from one 
heat bath to the other. This is a typical nonequilibrium steady state. 

3.1.2 Shear flow 

The second example is a fluid under shear. Consider a fluid in a box shaped container 
whose upper and lower walls are made of a "sticky" material. The upper wall moves with 
a constant speed Y while the lower wall is at rest 26 . We assume that the fluid is in touch 
with a heat bath at constant temperature T. Since the moving wall does a positive work 
on the fluid, the fluid must constantly throw energy away to the bath in order not to heat 
up. 

If we keep the system in this setting for a sufficiently long time, it finally reaches a 
steady state in which the fluid moves horizontally with varying speeds as in Fig. The 
wall constantly injects energy into the system as a mechanical work while the fluid releases 
energy to the heat bath. This is another typical nonequilibrium steady state. 

Since the fluid gets no acceleration in a steady state, the total force exerted on the 
whole fluid must be vanishing. This means that the forces that the upper and the lower 
walls exert on the fluid are exactly opposite with each other. The same argument, when 
applied to an arbitrary region in the fluid, leads to the well-known fact that the shear 
stress, defined as the flux of horizontal momentum in the vertical direction, is constant 
everywhere in the sheared fluid. 

3.1.3 Electrical conduction in a fluid 

The third example is electrical conduction in a fluid as in Fig. El When a constant electric 
field is applied to a conducting fluid which is in touch with a heat bath at a constant 

26 One should device a proper geometry (periodic boundary conditions) to make it possible for the upper 
wall to keep on moving. 
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Figure 6: An electrically conducting fluid attached to a heat bath is put in a 
uniform electric field. In a steady state one has a constant electric current. Joule 
heat generated in the fluid is absorbed by the heat bath. 



temperature, there appears a steady electric current. It should be noted that the electric 
field does not generate particle flow in the fluid, but only generates a flow of electric 
carriers 27 . Since a normal conductor always generates Joule heat, there is a constant flow 
of energy to the heat bath. This is also a typical nonequilibrium steady state. 



3.2 Local steady state 

Let us discuss the notion of local steady state which is central to our study. 

To be concrete let us concentrate on the case of heat conduction in a fluid (sec- 
tion I3.1.1|) . In general the local temperature and the local density of the fluid vary 
continuously as functions of the position 28 . If one looks at a sufficiently small portion 
of the fluid, however, both the temperature T and the density p are essentially constants. 
In the standard treatment of weakly nonequilibrium systems (see section 1.3.1(d)| ), one 



assumes that the state within the small portion can be regarded as the equilibrium state 
with the same T and p. Then the whole nonequilibrium state with varying temperature 
and density is constructed by "patching" together these local steady states. 

In general situations where the system is not necessarily close to equilibrium, however, 
this treatment is not sufficient. No matter how small the portion may be, there always 
exists a finite heat flux going through it. Therefore the local state in this small portion 
cannot be isotropic. Since equilibrium states are always isotropic in a fluid, this means 
that the local state cannot be treated as a local equilibrium state. It should be treated 
rather clS 8b local steady state. 

A local steady state is in general anisotropic. It is characterized by the temperature T, 
the density p, and (at least) one additional parameter (which we do not yet specify) which 
measures the "degree of nonequilibrium." Macroscopic quantities of the heat conducting 
fluid, such as the pressure, viscosity, and heat conductivity, should in principle depend not 
only on T and p but also on the additional nonequilibrium parameter. The main goal of 
our work is to present a thermodynamics that applies to local steady states 29 . 



27 There must be a mechanism to move the carrier from one plate to the other so that to maintain a 
steady current. When the carrier is electron, this is simply done by using a battery as in Fig. 

28 Although the density is defined unambiguously in any situation, the definition of temperature is 
much more delicate. Here we simply assume that the local temperature can be measured by a small 
thermometer. We will discuss more about the definition of temperature in section T8. 3. II 

29 As a next step, one wishes to see how these local steady states can be "patched" together to form a 
global nonequilibrium steady state. We hope this will be a topic of our future works. 
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Figure 7: Local steady state for heat conduction, (a) There is a temperature gradient 
and heat flux in the vertical direction, (b) If one concentrates on a thin region of the 
system, the temperature T and the density are essentially constant. This is a local 
steady state, (c) We further assume that the same local steady state can be realized 
in a thin system by adjusting the temperature of the upper and the lower walls. 

3.3 Realization of local steady states 

As a next step we discuss how one can realize local steady states in each of the concrete 
examples. 

3.3.1 Heat conduction 

Consider again heat conduction in a fluid. Suppose that the system has a nice symmetry 
and we get a steady state which is transitionally invariant in the horizontal directions. 
The heat flux flows in the vertical direction as in Fig. [7| (a). We let the heat flux J be the 
total amount of heat that passes through an arbitrary horizontal plane in the fluid within 
a unit time. Note that the heat flux J is independent of the choice of the plane because 
of the energy conservation. 

Take a region in the fluid in between two (fictitious) horizontal planes. If the width 
of the region is sufficiently small, the temperature and the density in the region may be 
regarded as constant. This thin system realizes a local steady state for heat conduction 
as in Fig. (b). 

Suppose that one inserts into the fluid a horizontal wall with very efficient thermal 
conductivity and negligible thickness. Since there is no macroscopic flow of fluid to begin 
with, and the temperature is constant on any horizontal plane, it is expected that the 
insertion of the wall does not cause any macroscopically observable changes 30 . Then one 
can replace the two (fictitious) planes that determine the thin region with two conducting 
horizontal walls without making any macroscopic changes. Moreover, by connecting the 
two walls to heat baths with precise temperatures, one can "cut out" the thin region from 
the rest of the system as in Fig. [7| (c). In this manner we can realize a local steady state 
in an isolated form. 

30 This statement is not as obvious as it first seems. In reality there often appears a seemingly discon- 
tinuous temperature jump between a fluid and a wall. Our assumption relies on an expectation that this 
jump can be made negligibly small by using a wall made of a suitable material with a suitable surface 
condition. 
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3.3.2 Shear flow 



In the case of sheared fluid (section I3.1.2J) identification of a local steady state is (at least 
conceptually) much easier. If the contact with the heat bath is efficient enough, one may 
regard that the whole system has a uniform temperature. If this is the case, the state of 
the whole system is itself a local steady state. 

When the temperature difference within the fluid is not negligible, one may again focus 
on a thin region to get a local steady state. The technique of inserting thin walls can be 
used in this situation as well. We here use a sticky wall with a negligible width and insert 
it horizontally in such a way that it has precisely the same velocity as the fluid around it. 
We can then isolate a local steady state 31 . 

3.3.3 Electrical conduction in a fluid 

The case of electrical conduction in a fluid (section I3.1.3|) can be treated in a similar 
manner as the previous two examples. If there are variations in the temperature or the 
density, we again restrict ourselves to a thin horizontal region to get a local steady state. 
When electrons carry current, an electrically conducting thin wall with a precisely fixed 
electric potential may be inserted to the fluid without changing macroscopic behavior. 

4 Basic framework of steady state thermodynamics 

As a first step of the construction of steady state thermodynamics (SST), we carefully ex- 
amine basic operations to local steady states (section l4~Tj) . Then we discuss how we should 
choose nonequilibrium thermodynamic variables ( section l4.2j) . To make the discussions 
concrete, we first restrict ourselves to the case of heat conduction. Other cases are treated 
separately ( sections 14.31 and l4.4|) . 

4.1 Operations to local steady states 

As we saw in section I2~T| various operations (i.e., decomposition, combination, and scaling) 
on equilibrium states are essential building blocks of equilibrium thermodynamics. We 
shall now examine how these operations should be generalized to nonequilibrium steady 
states. This is not at all a trivial task since nonequilibrium steady states are inevitably 
anisotropic, and there is a steady flow of energy going through it. 

We examine the case of steady heat conduction in a fluid. In order to find general 
structures of steady states, we examine a heat conducting state between the temperatures 
Ti ow and Thigh (Fig- El (a)). We still do not take the limit of local steady states. 

There are two natural (and theoretical sensible) ways of decomposing the steady state. 
In the first way, one inserts a thin horizontal wall with efficient heat conduction as in 
section 13.3.11 Then one measures the temperature of the wall (which we call T mi< x) and 
attach the wall to a heat bath with the same temperature T mi( ^. We expect that these 
procedures do not cause any macroscopically observable changes. Finally one splits the 

31 When there is a temperature gradient, one gets a local steady state with a heat current as well as a 
shear. We here assume that the latter has a dominant effect. 
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Figure 8: Two possible ways (b), (c) to decompose a heat conducting steady state 
(a). Both the ways are theoretically sensible. 
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Figure 9: Two possible ways of combining two heat conducting states which have 
different densities, (a) Contact through a horizontal wall does not change the two 
states as long as the temperatures at the attached walls (denoted as T m \&) coincide 
and the heat flux J in the two states are identical, (b) Contact through a conducting 
vertical wall may inevitably lead to a modification of the heat flow pattern. We are 
therefore led to consider only the vertical combination/decomposition scheme (a). 



middle wall into two, and gets the situation in Fig. [SI (b), where one has two steady states. 
In the second way, which is much more straightforward, one simply inserts a thin adiabatic 
wall vertically to split the system into two as in Fig. El (c). One can of course revert these 
procedures, and combine the two states to get the original one. 

We next examine how one should combine two heat conducting states which have differ- 
ent densities (or which contain different kinds of fluids). One natural way is a combination 
in the vertical direction. We prepare two heat conducting states between T\ ow and T mi d 
and between T mi a and Thigh- The two systems have the same horizontal cross sections. We 
then attach the two walls with the temperature T mid together as in Fig. El (a). If the two 
states have exactly the same heat flux J, there is no heat flow between the middle wall 
and the heat bath with T mi( j. This means that we can simply disconnect this heat bath 
without making any changes to the combined steady states. This way of combining two 
steady states always works provided that the temperatures at the attached walls are the 
same (which is T m id) and the heat flux J in the two states are identical with each other. 
We can regard this as a natural extension of the combination of two states frequently used 
in equilibrium thermodynamics. 
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Figure 10: Scaling in a local steady state of a heat conducting fluid. We fix the 
horizontal cross section and scale only in the vertical direction by a factor A > 0. 
The height h (and hence the volume), the amount of substance N, and the (small) 
temperature difference AT are scaled by A, while the temperature T and the heat 
flux J are unchanged. 

As in the decomposition scheme, we can also think about combinations in the horizontal 
direction. We can put two heat conducting states together along a vertical heat conducting 
wall as in Fig. El (b). This combination scheme too may look reasonable at first glance. But 
note that the contact always modifies the heat flux pattern unless the vertical temperature 
profiles of the two states before the contact are exactly identical. Since two different fluids 
(or fluid in two different densities) generally develop different (nonlinear) temperature 
profiles, we must conclude that in general this horizontal contact modifies the two states. 
It therefore cannot be used as a combination scheme in thermodynamics 32 . 

In conclusion, the decomposition/combination in the vertical direction (in which one 
separates a system, or puts two systems together along a horizontal plane) works in any 
situation, while that in the horizontal direction is less robust. The advantage of the former 
scheme is that it relies only on a conservation law that is independent of thermodynamics. 
More precisely the constancy of the heat flux J is guaranteed by the energy conservation 
law and the steadiness of the states. We are therefore led to a conclusion that, in nonequi- 
librium steady states for heat conduction, the decomposition and combination of states 
should be done in the vertical direction using horizontal planes, keeping the horizontal 
cross section constant. See, again, Figs. El(b) and El (a). 

For a local steady state, which is defined on a sufficiently thin system, one can define 
a scaling operation. Following the decomposition/combination scheme, we shall fix the 
cross section of the system and scale only in the vertical direction 33 . When doing this 
we must carefully chose the (small) temperature difference so that the heat flux J is kept 
constant. See Fig. [TU1 
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4.2 Choice of nonequilibrium variables 



We now turn to the problem of describing local steady states in a qualitative manner. 
The main issue here is how one should choose a new thermodynamic variable representing 
the "degree of nonequilibrium." Rather surprisingly, we will see that, by assuming that a 
reasonable thermodynamics exists, we can determine the nonequilibrium variable almost 
uniquely. 

Let us again use the heat conduction as an example, and take a sufficiently thin system 
to realize a local steady state. To characterize the local steady state, we definitely need the 
temperature T, the volume V, and the amount of substance N. Note that we only need 
a single temperature T since a local steady state has an essentially constant temperature. 
In addition to these three variables, we need a "nonequilibrium variable" as we discussed 
in section 

When choosing the nonequilibrium variable, we first postulate that the variable should 
correspond to a physically "natural" quantity. Then, in a local steady state for heat 
conduction, there are essentially two candidates. One is the heat flux J, which is the 
total energy that passes through any horizontal plane within a unit time. The other is the 
temperature difference AT between the upper and the lower walls 34 . 

To see the characters of these nonequilibrium variables, we examine the scaling trans- 
formation of the local steady state (Fig. 110)1 . When the system is scaled by a factor A > 
in the vertical direction, the extensive variables V and N are scaled to become AV^ and 
XN, respectively, while the intensive variable T is unchanged. The heat flux J is is un- 
changed because we want to keep the local state unchanged. (More formally speaking, it 
is our convention, which followed almost inevitably from the considerations in section m 
to keep J constant when extending the system in the vertical direction.) The temperature 
difference AT, on the other hand, must be scaled to AAT in order to maintain the same 
heat flux. Therefore, within our convention of scaling, the nonequilibrium variable J acts 
as an intensive variable while AT acts as an extensive variable. 

Thus our parameterization of a local steady state can either be 35 (T, J; V, N) or 
(T; V, N, AT) . We wish to examine whether we can get consistent thermodynamics by 
using these parameterizations. 

We first argue that a thermodynamics with the parameterization (T; V, N, AT) is in- 
consistent, or, to say the least, not useful. To demonstrate this we consider the situation 
in Fig. where a single fluid of volume V is separated into two parts by a horizontal 
wall. The volumes and the amounts of fluid in the lower and upper parts are fixed to V\, 

32 If the temperature profiles are always linear, then one can say that the two profiles with the same 
terminal temperatures are identical. One might think this is always the case in local steady states realized 
in very thin systems. But we point out that, no matter how thin a system may be, there can be a phase 
coexistence in it, which leads to a nonlinear temperature profile. Therefore the horizontal combination 
scheme in heat conduction may be useful only when one (i) restricts oneself to local steady states, and 
(ii) rules out the possibility of phase coexistence. We still do not know if we can construct a meaningful 
thermodynamics starting from this observation. 

33 The scaling factor A should not bee too large to keep the state a local steady state. 

34 We have assumed that the temperature in a local steady state is essentially constant. But there 
must be a nonvanishing temperature difference AT to maintain the heat conduction. Of course we have 
AT < T. 

35 Recall the notation to separate intensive and extensive variables by a semicolon. See section 12 .1.1 1 
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Figure 11: A local steady state with heat conduction is separated into lower and 
upper parts (with the volumes and the amounts of fluid equal to V\, V 2 , and Ni, 
N 2 , respectively) by a thermally conducting horizontal wall. The temperatures T 
and T + AT of the lower and the upper walls, respectively, are fixed. We want to 
determine the temperature T + AT* at the separating wall. 



V2, and Ni, N 2 , respectively. The separating wall is thermally conducting. The upper and 
the lower walls are fixed, and have fixed temperatures T + AT and T, respectively, where 
AT <C T. The temperature T + AT* at the separating wall is not fixed, but should be 
uniquely determined in the steady state. 

Let us note that the situation here is completely analogous to those we have seen in 
section 12.1. HI (See, in particular, the discussion at the end of the section.) Here the 
temperature difference in the lower part (i.e., the difference between the temperatures of 
the lower wall and the separating wall) is ATi = AT*, while that in the upper part is 
AT 2 = AT — AT*. Since AT is fixed, their sum ATx + AT 2 is fixed. Let us assume that the 
general structure of thermodynamics is maintained here. Then there should be an intensive 
quantity v(T\ V, N, AT) which is conjugate to AT, and AT* should be determined by the 
balance condition 

u(T; Vi, Nt, AT*) = u(T; V 2 , N 2 , AT - AT*). (4.1) 

We know, on the other hand, that the balance of heat flux between two subsystems 
can be universally expressed by the equality 

J(T; V u Nx, AT*) = J(T; V 2 , N 2 , AT - AT*), (4.2) 

where J(T; V, N, AT) is the heat flux written as a function of T, V, N, and AT. Since the 
two conditions (j4.1j) and ()4.2j) should be equivalent for each T, there must be a function 
g(J,T) such that 

z/(T; V, N, AT) = g{J{T- V, N, AT), T), (4.3) 

for any T, V, N, and AT. But note here that the quantity v (which is conjugate to 
AT) is dimensionless 36 while the heat flux J has the dimension of energy divided by 
time. This means that the function g(J,T) must include (at least) one universal constant 
which has the dimension of time 37 . But it is quite unlikely (if not impossible) that a 
theory requires such a new universal constant. We must conclude that a thermodynamics 
with the parameterization (T; V, N, AT) of local steady states (even if it exists) is highly 
unnatural. 

36 Our convention is that temperature has the dimension of energy. 

37 For example, g(J,T) = t J/T is dimensionless when to is a constant with the dimension of time. 
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Figure 12: Decomposition of a steady state of sheared fluid. One inserts a thin 
horizontal wall with the precise velocity T' as in (b). By splitting the two parts and 
Galilei transforming the upper system, one gets the situation in (c). Note that the 
shear force r is preserved in this decomposition. When combining two states, one 
starts from (c) and goes back to (b). 

On the other hand, a thermodynamics with the parameterization (T, J; V, N) does 
not suffer from such a pathology. Here the "degree of nonequilibrium" is directly taken 
into account through the intensive variable J, which directly accounts for the energy 
conservation law. Since the role of an intensive variable in thermodynamics is to set the 
environment for the system, there is no room for internal inconsistencies to appear. 

We are therefore led to the conclusion that a heat conducting local steady state should 
be parameterized as (T, J; V,N), where the nonequilibrium variable J is intensive 38 . 

The general lesson is as follows. To get a sensible thermodynamics, the "degree of 
nonequilibrium" should be taken into account through an intensive variable which mani- 
festly represents a conservation law that is imposed by physical laws out of thermodynam- 
ics. An extensive nonequilibrium variable which looks natural from a physical point of 
view may not be natural for a thermodynamic theory. This is because the corresponding 
variational principle may conflict (or may become redundant) with the already existing 
conservation law. 

4.3 Shear flow 

Let us examine how the discussions in sections 14.11 and 14.21 should be extended to local 
steady states of a sheared fluid. 

Let us start from the decomposition/ combination scheme. If the fluid is two-dimensional 
(as in Fig. EJ), then it is obvious that decomposition and combination must be done in the 
vertical direction along a horizontal line. Decomposition of combination in other direc- 
tions are simply impossible because of the horizontal flow. In a three dimensional fluid, 
one might first imagine that decomposition in other directions 39 can be used, but it turns 
out that it is not possible when there is a phase separation within the system. Anyway it is 
most natural to stick on a scheme which does not depend on the dimensionality. We shall 
always decompose or combine systems in the vertical direction, along horizontal planes. 

38 There is a possibility that a natural thermodynamic variable is a function i>{J) rather than J itself. 
See footnote 03 in section 1731 

39 For example one can think about cutting the system into two along a plane parallel to the page. 
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Figure 13: Two possible schemes of decomposition/combination in a steady state of 
fluid with electric current, (a) The first scheme is the same as that for heat conduction 
if we replace the heat flux J with the total electric current /. The charge conservation 
law ensures that the total current / is a "good" intensive nonequilibrium variable, 
(b) The second scheme makes use of the fact that the electric potential difference (ft 
is constant when one splits or combines systems along a plane parallel to the current. 
Then (ft becomes the intensive nonequilibrium variable. 

To decompose a steady state, one first inserts a thin sticky wall horizontally in such a 
way that the velocity of the wall is identical to that of fluid around it. We expect that this 
insertion does not modify the state macroscopically. Then one decomposes the inserted 
wall into two, and splits the system into two parts. Note that the shear force r is preserved 
in this process. If one wishes to bring both the states into the standard form (where the 
lower wall is at rest), one performs a Galilei transformation to the upper system as in 
Fig.IH 

When one combines two states into one, one first prepares two steady states (as in 
Fig. (c)) with the identical shear force r, and then combine them (after a Galilei 
transformation) as in Fig. 1121 (b). 

It is then obvious that the shear velocity T (which is the difference between the ve- 
locities of the upper and the lower walls) is the extensive variable, and the shear force 
t is the intensive variable. From an argument parallel to that in section 14 .'2\ we find 
that a thermodynamics with the parameterization (T; V, N, T) is inappropriate. We shall 
parameterize local steady states as (T, r; V, N), and look for a useful thermodynamics. 

4.4 Electrical conduction in a fluid 

Treatment of steady states in an electrically conducting fluid is somewhat more delicate 
than the other two examples. It seems that, in some situations, there are two completely 
different formulations of thermodynamics, whose relations are far from obvious (and not 
yet clear to us). 

Obviously it is possible to develop a scheme completely parallel to that for heat con- 
duction. For this, one simply identifies the total electric current I with the heat flux J. 
Then one decomposes, combines, and scales local steady states in the direction of the 
current as in Fig. E3(a). In the corresponding thermodynamics, the total electric current 
/ becomes the intensive nonequilibrium variable. Local steady states are parameterized 
as (T, J; V, N). 

But this is not the only possible thermodynamics. If one can neglect the effect of 




36 



charge screening at the walls, then the difference in the electric potential between the 
two walls is constant. The potential is unchanged if one decomposes the system along 
a plane parallel to the electric current as in Fig. EH (b). We can use the corresponding 
combination and scaling convention to construct a thermodynamics, where the electric 
potential difference (f) becomes the nonequilibrium intensive variable. Local steady states 
are parameterized as (T, 0; V, N). 

It is quite interesting that there are two different formulations of thermodynamics for 
a single physical system. The two are truly different theories since they are based on 
different schemes of scaling. One must note that the two possible theories can never be 
related with each other simply, for example, by a Legendre transformation. 

It is an intriguing problem to find the true meaning of the (apparent) possibility of 
the two formulations of thermodynamics. In particular it is exciting to find an "unifying" 
theory which includes the physics of both the theories, provided that both the theories are 
found to be physically meaningful 40 . 

5 Operational determination of thermodynamic quan- 
tities 

In section HJ we have determined the basic structure of steady state thermodynamics 
(SST), assuming that a sensible thermodynamics for local steady states does exist. We 
now turn to the task of determining thermodynamic quantities. In doing so, we insist 
on defining everything through operational procedures which are (at least in principle) 
experimentally realizable. 

In the present section, we discuss how one can determine the pressure (section 15. lj) 
and the chemical potential (section I5~2|) of a local steady state (T, v\ V, N), and further 
show that these quantities satisfy the Maxwell relation ( section l5.3|) . Here the variable v 
represents a general nonequilibrium intensive variable, and should be read as J, r, /, or 
(f) depending on the model that one has in mind. Although the pressure p(T, v\ V, N) is 
fully determined, we here determine only the V, N dependence of the chemical potential 
fj,(T, v\ V, N). Determination of T, v dependence will be discussed later in section 

The construction in the present section is fairly general and does not depend on specific 
systems. The convention is that when we say "vertical" direction, it means the direction 
to which we scale our systems. The reader should simply have in mind, for examples, 
Figs, EH E3 an d El and interpret the word "vertical" in the ordinary sense. Recall that 
we can think about two different formulations of thermodynamics for electric conduction 
in a fluid (section 14. 4 j) . 



37 



Figure 14: To be consistent with our convention of scaling, we measure the (mechani- 
cal) pressure in the vertical direction and identify it as the SST pressure p(T, v\ V, N). 

5.1 Pressure — a mechanical definition 

Pressure is a special thermodynamic quantity, which also has a purely mechanical charac- 
terization 41 . 

As usual the pressure of a local steady state is defined as the mechanical pressure or 
through the work needed to make a small change of volume. The only point we have to be 
careful about is that a nonequilibrium steady state is anisotropic. Since it is our convention 
to perform decomposition, combination, and scaling only in the vertical direction, we shall 
only speak about the pressure in the vertical direction. It is obtained as the mechanical 
pressure exerted on the horizontal walls, or through the relation AW = pAV where AW 
is the mechanical work needed to make a small volume change AV by moving a horizontal 
wall vertically. See Fig. El 

We denote the pressure thus determined as p(T, v\ V, N). Since the vertical force should 
not change when one scales the system in the vertical direction, we have the intensivity 

p{T,v;\V,\N)=p{T,u;V,N), (5.1) 

for any A > (which is small enough to maintain local steadiness). Note that in the case of 
electrical conduction in a fluid, two pressures p(T, I; V, N) and p(T, 0; V, N) corresponding 
to the two different formulations of thermodynamics are in general different. 

As in equilibrium, we expect the pressure p(T, u; V, N) to be nonincreasing in V. Oth- 
erwise a small fluctuation in the volume may be magnified, leading to a catastrophic 
volume change. 

5.2 Potential variation method and chemical potential 

In contrast to the pressure, the chemical potential is a purely thermodynamic quantity. 
Therefore to define it for local steady states is a highly nontrivial problem. In the present 
section, we introduce the method of potential variation, which enables one to determine the 

40 A less interesting possibility is that only one of the two is physically meaningful. (And much less 
interesting possibility is that none of them are.) 

41 We can say that equilibrium thermodynamics establishes quantitative connection with mechanics 
through the pressure and the internal energy. In our construction of SST, we make use of the pressure. 
But it is extremely difficult (if not impossible) to introduce the notion of internal energy to nonequilibrium 
steady states since there always is a constant flow of energy. Oono and Paniconi [2] indeed tried to define 
internal energy of SST by extending the notion of adiabaticy. In our construction, we do not make use of 
adiabaticy. 
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Figure 15: The method of potential variation which determines the difference in 
chemical potentials. An external potential which varies only in the vertical direction 
is applied. The densities of the fluid is p\ and P2 in the lower and the upper regions 
where the potential takes constant values u\ and u 2 , respectively. Then the chemical 
potential difference is determined by p(p\) -\-v,\ = p(p2) + u-i- 



difference in the chemical potential unambiguously. By using this method, we determine V, 
TV dependence of the chemical potential in a purely operational manner. To our knowledge 
this method of determining chemical potential was first pointed out and used by Hayashi 
and Sasa [4"Tj . 

Fix the temperature T and the nonequilibrium variable v. We denote by fi(p) = 
/i(T, v\ V, N) the chemical potential as a function of the density p = N/V. We have 
assumed the intensivity 

l x(T,u;\V,\N)=^T,u;V,N), (5.2) 

for any A > 0. 

Now we apply an external potential which generates a force 42 acting on fluid particles. 
The potential is equal to a constant u\ in the lower half of the system, and is equal to U2 
in the upper half. We assume that the potential varies smoothly in the vertical direction 
between the two regions. 

Let the system relax to its steady state under the applied potential. We denote by pi 
and p2 the densities of the fluid in the lower and the upper regions, respectively. Since 
the two regions can freely exchange fluid molecules and are in steady balance with each 
other, the chemical potential /i(p) (if exists) should satisfy the balance relation 

+ ui = (jl(p 2 ) + U2, (5.3) 

which is nothing but the nonequilibrium counterpart of the relation 1)2.14)1 in equilibrium 
thermodynamics. Note that we are again speaking only about contacts of two regions 
in the vertical direction. As in the definition of the pressure, all the notions should be 
consistent with our convention of scaling. 

To be more logical, we are here defining the chemical potential /i(p) as a quantity that 
satisfies the condition ()5.3j) . under the assumption that ()5.3|) for various U\ and u 2 lead 
consistently to a function /i(p). 

42 In the case of electrically conducting fluid, the present force is not an electric one. We have assumed 
that an electric field only affects the electric carriers, while the present potential couples with the whole 
fluid. 
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It seems obvious that p\ > p 2 when u\ < u 2l since the fluid feels a downward force in 
the boundary of the two regions. Then (J5.3|) implies that the chemical potential u(p) is a 
nondecreasing function of the density p. 

5.3 Maxwell relation 

A crucial point in our operational definitions of the pressure and the chemical potential is 
that they automatically imply the Maxwell relation 

dp(p) dp(p) 

~dp- = (5 ' 4) 

which is exactly the same as its equilibrium counterpart (J2.17)) . Here we still fix T, u, and 
write p(p) = p(T, v\ V, N) with p = N/V. 

To show the Maxwell relation ()5.4|) . we again consider the situation in Fig. EE where 
a varying potential is applied to a single fluid. Suppose that Am = w 2 — Mi > is small. 
Let us write densities as p\ = p and p 2 = p — Ap. By writing the density p{r) and the 
potential u(r) as a function of the position r, we can evaluate the total force exerted on 
the fluid from the potential as 

F u = -J d 3 rp(r)giadu(r) = ~{p + 0(Ap)} J d 3 r gradw(r) = -{p + 0{Ap)}A Au, 

(5.5) 

where A is the cross section area of the container, and we used the fact that p(r) = 
p + O(Ap) everywhere in the fluid. On the other hand, the forces exerted on the fluid 
from the upper and lower walls (as pressures) add up to 

F p = A{p(p)-p(p-Ap)}. (5.6) 

Since the fluid is in a steady state, we must have F u + F p = 0, which leads to 

p(p) - p(p — Ap) = pAu + 0{{Ap) 2 ). (5.7) 

From ()5.3|) . on the other hand, we have 

p(p) - p(p - Ap) = Au. (5.8) 

From (|5.7|) and (|5.8J) . one readily gets the desired Maxwell relation ()5.4|) by letting Am — > 0. 



6 SST free energy and its possible roles 

Since we have discussed the operational definitions of the pressure p(T, v\ V, N) and the 
chemical potential u(T, z/; V, N), we can now move on to the definition of the SST (Helmholtz) 
free energy F(T, v\ V, N). After noting the basic properties of the free energy ( sect ion f(j. 1)1 . 
we discuss two conjectures about its physical roles, namely, the extension of Einstein's for- 
mula for the density fluctuation fsection f6.2|) and the minimum work principle (section EEHj) . 

As in section discussions in the present section are fairly general, and apply to any 
of our examples. 
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6.1 Definition of free energy 

Let (T, u; V, N) be a local steady state. Since T and v are intensive, and V and iV are 
extensive, the extensivity of the free energy (to be defined) should read 

F(T,v;\V,\N) = \F(T,u; V,N), (6.1) 

for any A > (which is small enough to maintain local steadiness). Since this is identical 
to its equilibrium counterpart (|2.4j) . we expect our SST free energy to satisfy the same 
Euler equation (|2.15J1 as the equilibrium free energy. We therefore require 

F(T, v- V, N) = -Vp(T, v- V, N) + N p(T, u; V, N). (6.2) 

Note that this is consistent with the extensivity (|6.1|) of free energy and the intensivity 
(J5.1|) and (J5.2)) of the pressure and the chemical potential. 

Since we have already determined p(T, v\ V, N) and (the V, N dependence of) p(T, v\ V, N), 
we can regard the Euler equation (J6.2|) as our definition of the free energy. This deter- 
mines the V, N dependence of F(T, v\ V, N) completely for each fixed (T, v). Dependence 
of F(T, V] V, N) on T and v will be discussed later in section 17.31 

From the Maxwell relation (|5.4|) (which should better be rewritten in the form of 
()2.16|) ). we find that the free energy defined by (|6.2j) satisfies 

p{T, v\ V, N) = — , (6.3) 

and 

/i(T, u; V, N) = — , (6.4) 

as in the equilibrium thermodynamics (see ()2.8|) and (|2.12jl ). 

We can also show that F(T, v\ V, N) is jointly convex 43 in the extensive variables V 
and N. To see this, fix T and v and define the specific free energy by 

f(P)=H T > V > 1 >y) = y , (6-5) 

with p = N/V. Then the Euler equation ()6.2j) becomes 

f{p)=-p{p)+pM- (6-6) 

From this and the Maxwell relation ([5.4)1 . we find f"(p) = p'{p)- Since we have p'(p) > 
as argued in section I5~2l f(p) is convex in p, and hence 

JVi No N No 

/( k tt + (1 - < « /(t/) + (!-«) /( xt)' ( 6 ' 7 ) 

V\ V2 V\ V2 

for any Vy, V 2 , N lt N 2 , and < k < 1. By setting « = A V 1 /{\V 1 + (1 - A) V 2 } with 
< A < 1, (jniZD becomes 

F(T, u;XVi + (l- A) V 2 , A N x + (1 - A) N 2 ) < A F(T, u; V 1 , N x ) + (1 - A) F(T, u; V 2 , N 2 ), 

(6.8) 

which shows the desired convexity. 

43 See footnoteEli n section 12. 1.21 for the definition. The following discussion is quite standard. 
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Figure 16: The setting for discussion the density fluctuation formula (|6.9j) for 
nonequilibrium steady states. The situation is almost the same as that of Fig. 1151 
but the two parts are now separated by a horizontal wall with a small window in it. 



6.2 Density fluctuation 

Although we still do not know T, v dependence of the free energy F(T, v\ V, N), its de- 
pendence on V and N may give interesting physical information. In the present and the 
next subsections, we discuss two of such conjectures. 

Consider the situation in Fig. EH where the potential which is equal to U\ in the lower 
half and equal to u 2 i n the upper half is applied. This is almost the same as the situation 
in Fig. but we separate the two parts by a horizontal wall with a small (but much 
larger from the molecular scale) window in it. The wall is prepared so that the two parts 
maintain the same "degree of nonequilibrium." Since the two parts will reach mechanical 
and thermodynamic balance via the window, the densities p\ and p 2 in the steady state 
is the same as that attained in the situation of Fig. 

In the average, the amounts of fluid in the two parts are equal to p\V and P2V, 
respectively, where V is the volume of each part. As long as the volume is finite, however, 
there exists a fluctuation in the amounts of fluid or in the densities. We conjecture that 
this density fluctuation can be described by the S ST free energy, just as in the equilibrium 
case ()2.6|) . (See also ()2.22|) .) To our knowledge, such a fluctuation relation in steady states 
was first proposed by Hayashi and Sasa jUj. 

To be precise, denote the amounts of substance in the lower and the upper parts as 
Aq and N 2 , respectively. Since the fluid can move through the porous wall, Aq and N 2 
may vary while N\ + N 2 is exactly conserved. We denote by p(Aq, N 2 ) be the probability 
density for the partition (Aq, N 2 ) of the amounts of fluid. Then, for each steady state with 
fixed T, v u±, and u 2 , it is expected that the Einstein's formula 

p(Aq, N 2 ) ~ const. exp[-/5{F(T, u; V, Aq) + F(T, u; V, N 2 ) +u 1 N 1 + u 2 A 2 }], (6.9) 

is valid, where (3 = l/{k^T) is the inverse temperature. 

We shall later show that the fluctuation formula (J6.9j) holds exactly in the sheared fluid 
with weak contact ( Appendix IA.3|) . and the driven lattice gas ( Appendix IB.4|) . 

It is quite important to note that the conjectured relation ()6.9|) can be checked by exper- 
iments which are independent of those necessary to determine the free energy F(T, v\ V, N). 
Therefore we are proposing a highly nontrivial statement for general (not necessarily weak) 
nonequilibrium systems that can be verified (or falsified) purely by experiments. See sec- 
tion for further discussions. 
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Remark 1: When the density fluctuation is governed by the Einstein's formula (|6.9|) . it is 
likely that linear response relations for transport or relaxation phenomena in the vertical 
direction are also valid. For example, if one starts from the steady state with u\ = Ui = 
and suddenly applies at time t = a weak potential difference Au = u<i — u%, we expect 
the fluctuation response relation 



for t > to be valid. Here (• ■ -)o is the expectation in the steady state with u\ = U2 = 0. 
See section lA. 41 and section lB.61 for more details in concrete examples. To our knowledge, 
such linear response relations in a highly nonequilibrium steady state was first discussed 
in [EH- 

Remark 2: One might naively expect the fluctuation relation (J6.9j) to hold in the situation 
of Fig. where the two parts are separated by a a fictitious horizontal plane. Although 
the corresponding relation in equilibrium holds either when the wall is real or fictitious, 
the situation may not be that simple in nonequilibrium steady states. In nonequilibrium 
steady states, one generally finds spatial long range correlations, which lead to anomalous 
density fluctuations [20]- (See section 18.3.21 ) It is likely that a simple Einstein type 
relation for fluctuation does not hold because of this anomaly. The contact via a small 
window considered above is expected to diminish the long range correlation between the 
two subsystems, while maintaining macroscopic balance of the two systems. This is clearly 
seen in our treatment of the driven lattice gas in Appendix IB. 31 See also Appendix [X] for 
still "safer" design of the contact. 

6.3 Minimum work principle 

We also conjecture that there exists a steady state version of the minimum work principle 
(see section 12.1. 2 j) and that the SST free energy plays a central role in it. 

Let us discuss only the simplest version in the present section. Later in Appendix IB. 51 
we shall discuss more about the minimum work principle in the contexts of driven lattice 
gas. 

We conjecture that a straightforward generalization of the inequality ()2.5j) in equilib- 
rium holds in a local steady state. However there is a sever restriction on mechanical 
operations performed to the system. To be consistent with our basic framework to change 
the geometry of the system only in the vertical direction, we allow the external agent to 
change the volume of the system only by moving the upper (or the lower) wall vertically. 
We require that the intensive variables T and v are kept constant during the operation. 
Then the conjectured minimum work principle for local steady states is 



where V and V are the initial and the final volumes, respectively, and W is the mechanical 
work that the outside agent has done to the system. It is crucial here that W is the ordinary 
mechanical work, not an exotic (and often ill-defined) quantity like "nonequilibrium work 



(Ni(t))Au = (Ni)o + AuP(Ni {Nt{t) - iVi(0)}) + 0((Au) 2 ) 



(6.10) 



W > F(T, v; V\ N) - F{T, v\ V, N), 



(6.11) 
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." The outside agent need not care whether the system is in an equilibrium state or in 
a steady state. 

In the limit where the operation is indefinitely slow, the relation (jfi.Hj) for the pressure 
implies that the minimum work principle (jfi.llj) is satisfied as an equality. (This is indeed 
almost the definition of the pressure.) Then the conjectured inequality (j6.11|) looks plau- 
sible since we usually have to do extra work when an operation is not slow enough for the 
fluid to follow. 

We stress that the restriction on allowed operations is essential. Since some of the 
nonequilibrium steady states have a macroscopic flow, the agent may make use of it to 
reduce her work (or even to get a positive amount of energy from, say, a waterwheel) 
if arbitrary operations are allowed. This is in a stark contrast with the minimum work 
principle in the equilibrium thermodynamics, where the agent can perform any mechanical 
operations allowed by physics laws. 

To summarize, our message is that the minimum work principle may be extended to 
general nonequilibrium steady states provided that one carefully restricts allowed opera- 
tions. We stress that this too is a highly nontrivial conjecture that can be checked purely 
by experiments. 

7 Steady state thermodynamics (SST) in a complete 
form 

In the present section, we discuss an operational method to determine the dependence of 
the chemical potential on T and v. The basic idea depends on a new postulate that there 
are walls (that we call //-walls) which realize a natural contact between an equilibrium state 
and a steady state ( sections 17.11 and I7.2J) . This determines the free energy F(T, v\ V, N) 
(section [721), an d completes our construction of steady state thermodynamics (SST). 

The complete SST leads us to predictions of two new phenomena, namely, the flux- 
induced osmosis (FIO) (sections 17.41 and I7.5j) . and a shift of coexistence temperature 
( section l7.6|) . We show that both the phenomena are described by the new nonequilib- 
rium extensive quantity \I/(T, u; V, N) that we shall introduce. These two are intrinsically 
nonequilibrium phenomena that can never be described within the equilibrium or the local 
equilibrium treatments. 

7.1 Contact of a steady state and an equilibrium state 

As in sections El and IH1 we treat a general local steady state parameterized as (T, u; V, N). 

We shall now think about bringing a local steady state (T, u; V, N) in contact with an 
equilibrium state (T, 0; V, N'), allowing the two states to slowly exchange the fluid. To be 

In the framework of SST proposed by Oono and Paniconi [2J, the conjectured minimum work principle 
is expressed in terms of "excess work" which is obtained by subtracting a "house-keeping heat" from the 
total mechanical work. Such a decomposition of the work with a generalized second law was demonstrated 
in a Langevin model |85| . Quite recently, an identity leading to this generalized second law was tested 
experimentally |8fi| . 
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Figure 17: Combination of a nonequilibrium steady state (lower part) and an equi- 
librium state (upper part) in (a) heat conducting fluid, (b) sheared fluid, and (c) elec- 
trical conduction in a fluid. The separating walls are made of a porous material, and 
fluid can pass to the other sides through narrow complicated paths. This setting will 
be the basis for our determination of the chemical potential and the free energy. 



consistent with the general scheme of SST, we put the two states together in the vertical 
direction, separating them with a horizontal wall. 

The separating wall should probably be made of a porous material which has many 
narrow complicated paths through which the fluid can pass slowly. 

In the case of a heat conducting fluid (section 1*3.1.1(1 . we suppose that the porous wall 
has very high heat conductivity, and is in touch with a heat bath which has the same 
temperature T as the upper most wall. See Fig. [T7] (a). The lower most wall is kept at a 
different temperature T + AT. In this manner, we can realize a heat conducting (local) 
steady state in the lower half of the system, and an equilibrium state with temperature T 
in the upper half of the system. 

In the case of a sheared fluid (section [3. 1.2 J) , we suppose that porous wall has "sticky" 
surfaces and is at rest. See Fig. 1171(b). The upper most wall is also at rest, while the lower 
most wall moves with the speed T. In this manner, we realize a (local) steady state with a 
constant shear in the lower half, and an equilibrium state in the upper half. We of course 
assume that the whole system is in an efficient contact with a heat bath at temperature 
T. 

As for electrical conduction in a fluid (section l3.1.3|) . we have to be careful. When 
we employ the (T, 0; V, N) formalism of SST (see Fig. [T3] (b)), it is impossible to put an 
equilibrium state on top of a steady state. This is because a steady state in this setting 
has a uniform electric field in the horizontal direction in it, while an equilibrium state 
has no electric field. Such a configuration is inhibited by the law of electrostatics, i.e., 
rot E = 0. We therefore exclude the (T, 0; V, N) formalism from our considerations in the 
present section. 

As for the (T, J; V, N) formalism of SST for electrical conduction in a fluid (see Fig. [TBI (a)), 
the contact causes no apparent problems. We suppose that the porous wall is electrically 
conducting, and let the porous wall and the upper most wall have the same electric poten- 
tial. See Fig. El ( c )- By letting the the lower most wall have a different potential, we will 
get a steady state with a constant electric current in the lower half, and an equilibrium 
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state in the upper half. Again the whole system is assumed to be in touch with a heat 
bath at temperature T. 

7.2 Complete determination of the chemical potential 

Our new (and fundamental) postulate is that, if a steady state (T, v\ V, N) and an equi- 
librium state (T, 0; V' , N') are in contact with each other as in section 17.11 we have the 
equality 

li(T,v;V,N) = n(TW,N'). (7.1) 

In equilibrium thermodynamics, two systems which exchange substance and are in balance 
with each other always have equal chemical potentials. Our postulate ()7.1|) is a straight 
generalization of this principle. 

Since fi(T, 0; V, N') in the right-hand side is the chemical potential of an equilib- 
rium state, it is fully determined within the equilibrium thermodynamics. Therefore by 
preparing the contact between various steady states and equilibrium states, one can fully 
determine the SST chemical potential fi(T, v\ V, N) from the proposed equality (J7.1J) . 

It must be noted, however, that (|7.1|) is not a mere definition. In sections 15.21 we 
characterized the chemical potential /i(T, v\ V, N) using the method of potential variation, 
and determined the V, N dependence of /i(T, v\ V, N) for each fixed T and v. The equality 
()7.1|) must reproduce the same V, N dependence. 

Therefore what is essential in the postulate (|7.1j) is the assumption that there exists 
a wall which (through \7.1\j ) gives fi(T, v\ V, N) consistent with the potential variation 
method. Let us call a wall with this property a fi-wall. The existence of a perfect /x-wall 
is indeed far from obvious (although it can be established for the driven lattice gas as 
we see in section 15. 7|) . In fact we will see in section 1731 that there are walls which are 
not //-walls. The validity of our postulate should ultimately be verified through series of 
careful experiments. 

We assume that the chemical potential thus defined satisfies the symmetry 

n{T,w,V,N)=n{T,-v;V,N). (7.2) 

For a sheared fluid this is obvious from the original symmetry (i.e., Galilei invariance) 
of the system. For heat conduction and electrical conduction, we are assuming that the 
direction of the current does not affect the contact with equilibrium state. This is not 
entirely obvious, but seems plausible. Similarly we assume for the pressure that 

p(T,v;V,N)=p{T,-v;V,N). (7.3) 

7.3 Complete determination of the free energy 

Since we have completely determined the chemical potential /i(T,i/;V, N), and the pres- 
sure p(T, u] V, N), we use the Euler equation ()6.2|) to fully determine the free energy 
F(T,u;V,N). 

The free energy F(T,u;V,N) thus defined satisfies the extensivity (|6.1|) . is jointly 
convex in V and iV (as we saw in section iBTTjl . and has the symmetry 

F(T,w,V,N) = F(T,-v;V,N), (7.4) 
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because of (|7.2j) and (|7.3|) . Trusting in robustness of the mathematical structure of ther- 
modynamics, we further assume that the free energy F(T, u; V, N) is concave in the two 
intensive variables T and v. Although it is a general requirement in thermodynamics 
that the free energy is concave in an intensive variable, we still do not know what this 
assumption really means in the context of nonequilibrium steady states 45 . 

Assuming the differentiability of F(T, u; V, N), we can define (following equilibrium 
thermodynamics) the SST entropy 

S( r,^,A^- af <™ , (7.5) 

and a new nonequilibrium extensive quantity 

nT,,;V,N) = - SF ^ N \ (7.6) 

av 

Since the symmetry flQJ) implies #(T, u; V, N) = -*(T, -v- V, N), we find that \I>(T, 0; V, N) 
provided that \I/(T, z/; V, N) is continuous in v. Moreover the assumed concavity of 
F(T, v\ V, N) implies 

dV(T, v\ V, N) 



du 



> 0, (7.7) 



and hence we have 



> if v > 0; 

V{T,v;V,N) { =0 if z/ = 0; (7.8) 
< if v < 0. 

Since the inequalities (|7.8|) suggest that ^{T, v\ V, N) is a kind of measure of the "degree 
of nonequilibrium" , we call \I/(T, v\ V, N) the nonequilibrium order parameter 46 . 



7.4 Flux induced osmosis (FIO) 

We continue to study the situation in Fig. [T71 where a local steady state (T, v\ V, N) and 
an equilibrium state (T, 0; V, N') are in contact with each other. Thus the equality (|7. 1|) 
between the chemical potentials hold. 

Let us think about changing the nonequilibrium control parameter v slightly while 
keeping the temperature T, the volume V, and the equilibrium chemical potential /i eq = 
n(T, 0; V, N') constant. The last condition is met, for example, by making V and N' 
much larger than V and N, respectively. Since the chemical potential /i(T, u; V, N) must 
be also constant because of (J7.1|) . the amount of substance N in the steady state inevitably 
varies according to v. In what follows we write N(v) instead of N to remind this fact. 

By dividing the Euler equation ()6.2|) by iV and using the extensivity (|6.1|) of F and 
the intensivity 1)5. lj) . ()5.2|) of p, /i, we get 

F(T, u;v,l) = -vp(T, u; v, 1) + /i(T, u; v, 1), (7.9) 

In equilibrium thermodynamics, the concavity is directly related to the convexity and the variational 
principle for the conjugate extensive variable. To find out whether we have similar structure in SST is one 
of the important remaining issues. There is a possibility that we should use a monotone function i\){y) of 
v as the "correct" intensive nonequilibrium variable to have a meaningful conjugate extensive variable. 

46 As a simple minded analogy, imagine that v is the external magnetic field of a magnetic system. Then 
^ becomes the magnetization. 
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where v = V/N{y) is the specific volume. When the nonequilibrium variable v is varied, 
T and /i(T, u; v, 1) do not change while v may change. Thus by differentiating (|7.9|) with 
respect to u, we get 

- *(T, „; v, 1) - | p(T, „; 1) = -| p(T, „; 1) - . MZ^I> , (7 . 10) 

where we used f!7.6|) and ()6.3|) . This implies 

c>p(7>;F,iV(*/)) *(7>;V,iV(x/)) 



cV V 



(7.11) 



Since the pressure p(T, v\ V, iV(z/)) is equal to the equilibrium pressure p ea = p(T, 0; V, N') 
when v = 0, and the sign of the right-hand side of (|7.11|) is given by (|7.8p . we find that 

p(7>;V,JV(z/)) >p eq , (7.12) 

in general. For v ^ 0, the inequality is expected to become strict except in trivial systems 
where ^(T, u; V, N) is vanishing. 

We thus conclude that there inevitably appears a difference in the pressures of a 
nonequilibrium steady state and an equilibrium state which are in contact with each other 
and exchanging the fluid. The assumed concavity of the free energy in the nonequilibrium 
intensive parameter v implies that the pressure of the steady state is always higher. We 
call this pressure difference the flux-induced osmosis (FIO). 

We stress that the FIO is an intrinsically nonequilibrium phenomenon, which can 
never be predicted within the standard local equilibrium approach (see section 1.3.1(d) ). 



To confirm the existence of a FIO through careful experiments seems to be a challenging 
task, which will shed completely new light on the physics of nonequilibrium systems. We 
note, however, that an actual design of experiment may be nontrivial. See section IS. 2. 21 

The prediction of FIO in a heat conducting system may be rather surprising since 
we assert that a transfer of heat leads to a mechanical force acting on the porous wall. 
Let us note, however, that the appearance of mechanical force may not be too radical at 
least for dilute gases. In a dilute gas with a nonuniform temperature profile, it is known 
from the analysis of the Boltzmann equation that the pressure tensor becomes anisotropic 
|33j . It is then possible that a nonequilibrium steady state and an equilibrium state 
balance with each other to have different vertical pressures. In fact Kim and Hayakawa 
|3*o] , in their careful reinvestigation of the Chapman- Enskog expansion, examined a naive 
contact between a nonequilibrium steady state and an equilibrium state, and found that 
the pressure of the steady state is indeed larger than that of the equilibrium state 47 . A 
recent calculation based on Enskog's equation leads to a different conclusion [8*7j . 



7.5 /i-wall revisited 

Since the existence of a //-wall inevitably leads to the pressure difference between the 
steady state and the equilibrium state, we find that a //-wall must be able to support a 

47 Although they found a FIO with the correct sign, their contact is not a perfect /i-wall since the 
equality (|7.13|) is violated. We still do not know how one should realize a perfect /x-wall in dilute gases. 
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Figure 18: Two phases (say, liquid and vapor) separated by a horizontal plane 
coexist within a nonequilibrium steady state. We show that in general the coexistence 
temperature T c (p,v) shifts from its equilibrium value T c (p, 0). 



pressure difference. But clearly there exists a wall (which should be called a p-wall) which 
ensures that the pressures on its two sides are identical. For example, a "wall" made of a 
network of thin wires may be able to separate a steady state and an equilibrium state, but 
cannot support a pressure difference. In this case, we must conclude that there is a finite 
difference in the chemical potentials of the steady state and the equilibrium state, while 
the pressures are the same. This is in a sharp contrast with the situation in equilibrium 
thermodynamics, where any contact which allows the exchange of fluid keeps the chemical 
potential on both sides equal. 

We suspect that a perfect /i-wall and a perfect p-wall represent two different idealized 
limits of experimentally realizable walls. A general wall separating a steady state and an 
equilibrium state is expected to lie between these two limits. For a non-ideal wall, we still 
expect to observe a FIO with the same sign, but with a reduced magnitude. 

Let us derive a useful relation which enables one to check if an ideal //-wall contact 
is realized or not. Suppose that a steady state (T, v\ V, N) and an equilibrium state 
(T, 0; V, N') are separated by a perfect /i-wall and are in balance with each other. We 
fix T and u, and slightly change the density by varying V or V . Since both the steady 
state pressure p ss = p(T, v\ V, N) and the equilibrium pressure p eq = p(T, 0; V, N') satisfy 
the same Maxwell relation ()2.16|) and ()5.4|) . the changes of the pressures satisfy Ap eq = 
p eq A/i eq and Ap ss = p ss Afi ss , where A/i eq and A/i ss are the changes in the chemical 
potentials. But ()7.1|) implies A/i eq = A/i ss , and we get 

Apeq = Peq (? ^ 

Ap ss p ss 

The equality (|7.1Hj) may be checked experimentally to see if an ideal /i-wall is realized. 
7.6 Shift of coexistence temperature 

Again we consider a single local steady state. Suppose that there coexist two different 
phases, say, liquid and vapor, within the local steady state. We assume that the two 
phases are separated by a horizontal plane as in Fig. EI By using standard techniques 
in thermodynamics, we derive a nonequilibrium relation corresponding to the Clausius- 
Clapeyron relation. 

By (fictitiously) splitting the system into two along the phase separation plane, we 
get two local steady states in the low and the high temperature phases, respectively. We 
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denote the local steady states in the low and the high temperature phases as (T, v; V-, AL) 
and (T, v; V + , N + ), respectively. 

By dividing the Euler equation ()6.2|) by iV and using the extensivity (jbM|) of F and 
the intensivity (|5.1j) . (|5.2|) of p, /i, we get for each phase 

F(T, v- v ± , 1) = -v± p{T, v- v ± , 1) + /i(T, v- v ± , 1), (7.14) 

where v± = V±/N± are the specific volumes. It is convenient to fix the pressure p = 
p(T, v; V-, 1) = p(T, v\ v + , 1) constant. We denote by T c (p, v) the coexistence temperature 
at fixed p and v. Since the two phases coexist, we have 48 fi(T, v\ t>_, 1) = fi{T, v; v + , 1), 
which, with (17.14)) . implies 

F(T c {p,v) : v;v- : l) +v_p = F(T c (p,v),v;v +1 l) +v + p. (7.15) 

We fix p and differentiate ()7.15|) with respect to v. Noting that v± may depend on v to 
keep the pressure constant, we get 

01 ' M> - V) 5(T c (p, v\ v- v., 1) - *(T c (p, u), v- 1) 



dv 
dT c (p,u) 

dv 



S(T c (p, u), v- v + , 1) - *(r c (p, u), v- v+, 1), (7.16) 



where we used the definitions ()7.5|) and ()7.6|) of S and respectively. We therefore find 
the following nonequilibrium relation analogous to the Clausius-Clapeyron relation 

dT c {p, v) = ip+ - jj- 
dv s + — s_ ' 

where 

fe = E1Z^4^±), (7 . 18) 

and 

s± = S(T c (p,v),v;V ± ,N ± ) 
V± 

are the specific nonequilibrium order parameter and the specific entropy of the two phases. 

It is crucial to note that the nonequilibrium order parameter ip± can be determined by 
experiments using the FIO of section 17.41 Since the entropy s± may be approximated by 
their equilibrium values for small enough v, the right-hand side of ()7.17|) can be evaluated 
from experiments which do not involve a phase coexistence. This enables one to check (at 
least in principle) for the quantitative validity of the theory of SST in a purely experimental 
manner. 

The concavity of the free energy implies that in general the entropy S(T,p,v; N) is 
nondecreasing 49 in T. Thus we always have s+ > s_, and expect 



s_ > 0, (7.20) 



48 One may regard this balance condition as a special case of 1)5. 

49 To show this one Legendre transforms F(T, v; V, N) to G(T,p, v\ N) and use the relation S = —dG/dT 



as in equilibrium thermodynamics. 
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in general. Therefore the sign of the right-hand side of the Clausius-Clapeyron type 
relation (J7.17)) is determined by the sign of — 

Consider a sheared fluid and suppose that the low temperature phase is a solid 50 . Since 
the solid phase is hardly affected by the shear, it is likely that ip- is negligible. Then the 
relation (j7.17J) becomes 

dT c (p,r) = ^ 
Or s + — s_ 

The sign of the right-hand side of 1)7.21)) is precisely known by ()7.8|) and (|7.2U|) . We find 
that 

T c (p,r) <T c (p,0), (7.22) 

in general. Shear always induces melting of a solid. This prediction is consistent with the 
recent numerical experiments [EE] (where it was argued that the inequality (|7.22|) rules 
out (!) the possibility of a nonequilibrium thermodynamics). 

It is especially interesting to investigate experimentally the possible shift of coexistence 
temperature in a system with heat flow. The right-hand side of (|7.17|) may be positive 
or negative depending on systems. If T c (p, J) > T c (p,0), one will find a remarkable 
phenomenon of "heat flux induced condensation", i.e., one observes condensation of a low 
temperature phase near one of the walls which have slightly higher temperature than the 
normal transition temperature while the other wall has much higher temperature! 



8 Discussions 



8.1 Summary and perspective 

In the present work, we have step by step developed a full fledged thermodynamics that 
is expected to apply to a wide class of nonequilibrium steady states. We have tried hard 
to be as clear as possible in explaining our basic assumptions and reasoning behind the 
construction. We believe that our consideration about possible extensions of thermody- 
namics to nonequilibrium steady states is much more careful and rigorous than any other 
existing attempts. 

We have developed our theory in the level of purely macroscopic phenomenology, and 
clarified what conclusions we get from only phenomenological considerations. All ther- 
modynamic quantities are defined through experimentally realizable operations. We also 
made some nontrivial predictions that can be tested empirically. We shall discuss about 
possible experimental tests in section 18.21 

The reader may have noticed that there are, roughly speaking, three stages in our the- 
ory of SST. The first stage, developed in sections El and HJ deals with very basic framework 
of SST. We have examined basic symmetries of nonequilibrium steady states and funda- 
mental structures of thermodynamics, and made a rather strong restriction on possible 
theories. The second stage, developed in sections El and El deals with thermodynamics 
with fixed T and v. We have discussed important physics (the minimum work principle 
and the density fluctuation formula) that can be read off from the V, N dependence of the 

50 To consider a solid phase goes beyond our framework to treat only fluids. But let us be optimistic. 



51 



SST free energy. The third stage, developed in section [7J deals with SST in a complete 
form. We predicted the FIO and the shift of coexistence temperature. 

We believe that the logic in the first and the second stage is reasonably firm and 
reliable. Although a sound logic does not necessarily mean the validity of the theory, 
we are rather confident that our theory is realized in some nonequilibrium systems in 
nature. The theory in the third stage is definitely most interesting, but its logic is not 
as firm as the previous ones. First the notion of //-wall is not yet perfectly clear from an 
operational point of view, and must be further examined. Secondly, our assumption about 
the concavity of the SST free energy depends solely on the analogy with the conventional 
thermodynamics and has no operational foundation. We nevertheless wish to encourage 
experimental works for testing our predictions related to /i-wall contacts and clarifying the 
nature of contacts between equilibrium states and nonequilibrium steady states. Either 
verification or falsification of our predictions will provide hints for future development in 
nonequilibrium physics. 

A crucial point about the potential significance of SST is whether it becomes a useful 
guide in the (future) construction of statistical mechanics for steady nonequilibrium states. 
The fact that we have arrived at an essentially unique theory is rather encouraging. We 
hope that, by trying to construct a statistical theory that is consistent with the (unique) 
nonequilibrium thermodynamics, we are naturally led to a meaningful and correct statis- 
tical mechanics for steady nonequilibrium states. We shall discuss related issues in the 
Appendix |Bj where we look at SST from a microscopic point of view. 

8.2 Possibility of experimental tests 

Let us briefly discuss possible experimental verification of our predictions. Our aim here 
is not to go into details of concrete experimental setups but to make clear some essential 
points in our theory which need to be tested empirically. 

8.2.1 Chemical potential and fluctuation 

Probably the most promising experiments of SST are those designed to verify the formula 
for density fluctuation in nonequilibrium steady states (and the corresponding fluctuation- 
response relations) discussed in section lfT~2"l 

For this, one should prepare a system which is separated into two by a wall (which 
realizes a weak contact of the two subsystems), and in which an external potential can be 
varied. One then realizes a nonequilibrium steady state in the system. See, for example, 
Figs. El and El One should also be able to measure the amounts of substance in the two 
subsystems accurately 51 . 

In the first stage of experiments, one fixes T, u, and measures the averaged amounts of 
substance for various (fixed) values of the potential difference ui — U\. Then by using these 
data and the definition ()5.3|) of the chemical potential, one can experimentally determine 
fi(p) (up to an arbitrary additive constant). Of course nothing has been verified at this 
stage. 

51 A hopeful candidate is a system of charged plastic beads floating in water. 
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In the second stage of experiments (which may of course be carried out at the same 
time as the first stage), one measures the fluctuation of the amounts of substance Ni, N 2 in 
the two subsystems, again for fixed u\ and u 2 . Then our conjecture is that the probability 
to observe a partition into Ni and N 2 behaves as 

p(JV ls N 2 ) oc exp[-/3{F(T4, + u.N, + F(V 2 , N 2 ) + u 2 N 2 }], (8.1) 

where we dropped T and v. We have extended ()6.9|) to treat the case where the two 
regions have volumes V\ and V 2 . This enables us to get as much information as possible 
from this setting. 

Now if the fluctuation is small (which seems to be always the case in actual experiments 
for large systems), one may expand the above formula (j8.1|) to get 



p(AN) oc exp 



(8.2) 



where and N£ are most likely values of the amounts of substance determined by 
//(JVJ/VL) + Mi = n(N;/V 2 ) + U2, and AN = - Ni = N 2 - N% is the deviation. Thus 
the variance of the deviation AN is given by 



where p* = A^*/Vi. 

It must be noted that only //(p) (not p(p) itself) appears in the formula ()8.3|) of the 
variance. Since one has determined p'(p) unambiguously in the first stage, one can now 
check for the quantitative validity of (|8.3jl . Note also that one can increase the reliability 
of the conclusion by carrying out experiments with various values of u 2 — u\, and Vi, V 2 . 

As we shall discuss in section 18.3. 1[ there is a possibility that the inverse temperature 
(3 in ()8.3|) should be replaced with an "effective inverse temperature." Even if this is the 
case, a series of experiments with varying u 2 — u±, Vi, and V 2 is enough to check for the 
quantitative validity of the conjectured formula ()8.3|) . 

Moreover, one can determine the effective inverse temperature from a completely inde- 
pendent set of measurements. One can measure relaxation process which takes place after 
suddenly changing the potential difference, and compare it with static temporal correla- 
tions through the fluctuation-response relations like (j6.10J) or those described in section lA~4l 
and section IB~6l Since the parameter (3 appearing in fluctuation- response relations should 
be the same as those in the density fluctuation formula, this makes our proposal of exper- 
iments completely nontrivial. See also section lA. 51 for the similar discussion. 

The minimum work principle (j6.11|) may be also checked empirically, but we still do 
not know what can be conclusive experiments. 



8.2.2 Flux induced osmosis 

There is no doubt that the most exciting experimental verification of our SST is to directly 
observe flux-induced osmosis (FIO), especially in a heat conducting state, and directly 
measure the nonequilibrium order parameter Unfortunately this project seems still 



53 



not easy to carry out for several reasons. One essential difficulty is that we still do not 
know how one can realize a perfect /i-wall, which is necessary for a measurement of 
We imagine that a search for sufficiently good /i-walls should be done through a series of 
careful experiments using various different walls. 

Therefore the first step will be to confirm the existence of FIO in a system with not 
necessarily perfect /i-wall. This alone, we believe, can be an essential step toward a 
better understanding of truly nonequilibrium systems. But even this may not be easy 
since we have almost no a priori estimate for the magnitude of the pressure difference. 
The lack of quantitative estimates is characteristic to any thermodynamic arguments. 
Thermodynamics provides us with universal and exact relations, but not with numerical 
estimates. 

For dilute gases, however, we can make some rough estimates based on kinetic theory. 
Consider a heat conducting state of a dilute gas. We want to examine the dimensionless 
quantity 9 = (p ss — p e q)/p e q which characterizes the magnitude of the FIO. Let j be the 
heat flux per unit area. Since 9 should be an even function of j, it is expected that 9 is 
proportional to j 2 when j is small. Then the dimensional analysis shows that the only 
dimensionless combination (that includes j 2 ) of basic quantities is 

9 ~ ( 8 - 4 ) 

where m is the mass of the gas molecule. Of course p (which may be either p eq or p ss ) is 
the pressure and T is the temperature. This indeed is roughly equal to the magnitude of 
the anisotropy of the pressure tensor obtained from the Chapman- Enskog expansion [33] . 
The FIO obtained in the dilute gas calculation by Kim and Hayakawa JJ5] also has the 
same order of magnitude. 

To first confirm that FIO is negligibly small in the ordinary environment, let us examine 
the Ar gas at T = 273 K and p = 1 atm. The heat flux is given by j = k(VT) with the 
thermal conductivity k ~ 2.1 x 10~ 2 J (smK) -1 . As for the temperature gradient, let us 
set for the moment VT = 10 4 K/m (i.e., 100 K difference within 1 cm, which is easily 
realizable in the kitchen). By using m ~ 6.0 x 10~ 26 kg, we get 9 ~ 5 x 10~ n , which is 
miserably small as we anticipated. 

To get more general estimate and see what we can do, we further use the results from 
the gas kinetic theory to write 

^V^^ 2- ' (8 - 5) 

where d is the hard core diameter of the gas molecule. Then we get 



i.6) 



which is independent of T. The formula means that we must have low pressure as well 
as large temperature gradient in order to observe a large nonequilibrium effect. Let us 
set p = 10 Pa, for example, where the mean free path at room temperature is still not 
too large. Let us require 9 ~ 10~ 2 since a difference of 0.1 Pa may be detected by a 
diaphragm. Then since d ~ 10~ 10 m, we need to have VT ~ 10 3 K/m, which may not 
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be too unrealistic. Perhaps a major challenge in the realization of this experiment is to 
control convection and other non-thermodynamic effects. It was clearly pointed out in |SD] 
that, in a naive setting of FIO, the pressure difference due to the boundary effect (namely, 
the temperature gap) is proportional to the heat flux j, and hence overwhelms the effect 
predicted by SST. Therefore one should devise a special setting in which the temperature 
gap is eliminated to reveal the effect proportional to j 2 . (See also section IS. 3. 31 ) 

As for systems other than dilute gases, we have no estimates for FIO. We may simply 
hope that the nonequilibrium effects become large in some complex fluids. 

The conjectured shift of coexistence temperature is also an interesting topic of exper- 
iments. In this case, however, we have no a priori estimate at all. It is quite interesting 
to know if experiments like the one described in |9"U1 l9"T] have any relations with our 
predictions. 

8.3 Frequently asked questions 

During these four years that we have spent developing the present theory, we were repeat- 
edly asked some important questions in conferences, seminars, personal discussions, and 
referee reports. We shall summarize below our answers to some of these "frequently asked 
questions." 

Probably the most frequently asked question was about the possible relation of SST 
to some of the existing attempts in nonequilibrium physics. This is why we prepared 
section 11.31 where we listed some of the major advances in nonequilibrium physics and 
discussed their relevance (or irrelevance) to SST. We then concluded that there have been 
essentially nothing really similar to SST, concerning either basic philosophy or concrete 
theories. 

8.3.1 What is "temperature" in nonequilibrium steady states? 

In most stages of our phenomenological construction of SST, the role of temperature has 
simply been to keep the environment constant 52 . Therefore we did not have to be so 
careful about precise parameterization of the temperature. We simply used the same 
temperature scale as the heat baths, and declared that the temperature may be measured 
by a thermometer. 

In the future development of SST, however, it is quite likely that we must examine 
the notion of temperature more carefully, and study the behavior of the SST entropy in 
a quantitative manner. We will face the problem to determine the temperature which is 
intrinsic to a nonequilibrium steady state. Let us discuss one possibility here. 

We determined the V, N dependence of the free energy F(T, v\ V, N) in section 16.11 
using the pressure and the chemical potential. Both the quantities were determined op- 
erationally in section without references to the value of the temperature. The only 
requirement was that the temperature was fixed. 

In section l6~21 on the other hand, we discussed the formula (|6.9j) for density fluctuation. 
In this formula, the free energy appears in the dimensionless form F/(k-sT). We have so 

52 The only exception is the definition 1|7.5|) of the SST entropy, which involves a differentiation in T. 
But we did not have much quantitative discussions about the SST entropy. 
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far assumed simply that this T is the same temperature as the equilibrium temperature 
of the heat bath. (This is indeed the case in the driven lattice gas, See section IB. 41 ) 
But there is a possibility that this T should be replaced by an "effective temperature" 
intrinsic to the nonequilibrium steady state, which may not necessarily be the same as the 
equilibrium temperature. 

In other words, the fluctuation formula ()6.9|) may be used to experimentally determine 
the intrinsic nonequilibrium temperature since the free energy itself can be determined by 
other experiments which do not involve precise values of temperatures. Moreover, as we 
have discussed in section 18.2.11 measurements related to linear response relations may be 
used to determine the nonequilibrium temperature directly. 

From a theoretical point of view, the parameter (5 that appears in the formula (jB.46|) 
for the "weak canonicality" may be used to determine the nonequilibrium temperature of 
a stochastic model (which coincides with the usual temperature in the models studied in 
Appendix [B]) . 

8.3.2 Don't long-range correlations destroy thermodynamics? 

It is well-known that nonequilibrium steady states in a system with a conservation law 
generically exhibits spatial long range correlations [2U|. More precisely correlation func- 
tions of some physical quantities decay slowly with a power law, even though the system 
is not at the critical point. 

The mechanism of the long range correlation has been understood rather clearly from a 
phenomenological point of view, and the existence of long range correlations is confirmed in 
some experiments. There are also rigorous result [10] and explicit perturbative calculations 
|81| |4~4*1 which show that there indeed are such long range correlations in concrete 
stochastic models. No doubt the existence of long range spatial correlations is one of the 
intrinsic aspects of nonequilibrium steady states. 

One might rather naively imagine that the existence of long range correlations is not 
consistent with the existence of thermodynamics since the correlations may destroy exten- 
sivity or locality. But of course this is far from the case. The best argument may be the 
fact (which will be rigorously established in Appendix [BJ) that we can construct perfectly 
consistent SST for the driven lattice gas, which is a typical model known to exhibit long 
range correlations. We do not only obtain general formulae for the thermodynamic func- 
tions but also compute them in the limit of high temperature and low density. We find 
nothing pathological that originates from the long range correlations. 

The point is that the long range correlations show up (literally) in multi-point corre- 
lation functions, not in local observables. Thus they may lead to anomalous fluctuation 
of the sum of a certain quantity in a large region of the system. A notable example is 
anomalous density fluctuation mentioned in section 16.21 If one looks at local quantities 
such as the pressure, the temperature or the density, on the other hand, one observes noth- 
ing anomalous originating from the long range correlations. Thus all the thermodynamic 
quantities of SST, which are defined in terms of operations which involve local quantities, 
remain well-defined. 
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8.3.3 Why do you consider walls and contacts? 

The use of idealized walls and contacts may be the culture of thermodynamics. In con- 
ventional thermodynamics, one freely uses such devices as infinitely thin walls or per- 
fectly adiabatic walls, or sometimes more delicate ones like semipermeable membrane 53 . 
Decompositions, combinations, or contacts of various states realized by these walls play 
fundamental roles in the construction of thermodynamics. Of course boundaries are tricky 
objects even in equilibrium physics since properties of the system are inevitably modified 
near the boundaries. Nevertheless one can (very successfully) characterize bulk properties 
(not boundary properties) of equilibrium states by using all these walls and contacts. In 
many cases regions near boundaries are negligibly small compared with the bulk, and 
contacts are not modified by boundary effects. 

Simply speaking, we wish to adopt the same strategy in our approach to nonequilib- 
rium physics. We do consider various walls and contacts, but our main concern is to reveal 
universal properties exhibited by bulk of nonequilibrium steady states. Just as in equilib- 
rium thermodynamics, walls and contacts are mere probes with which we investigate bulk 
properties. 

Of course there is a possibility that one encounters various unexpected boundary ef- 
fects caused by highly nonequilibrium nature of the states 54 . That is why we have carefully 
discussed the settings of the systems, the ways we insert and remove walls, the ways we 
put two systems into contact, and so on. We have tried to minimize unwanted distur- 
bance of the states by the walls or contacts. Nevertheless there may still arise delicate 
material-dependent issues (like the temperature gap at boundaries) which complicate the 
analysis. In such cases, one should carefully distinguish such non-universal effects specific 
to boundaries from universal properties of the bulk, and try to minimize the former either 
theoretically or by experimentally devising a suitable setting. This may arouse nontrivial 
challenges for experimental designs, but we believe it is always possible in principle. 



8.3.4 Is SST useful? 

If one assumes that SST is a correct theory describing nature, one can still ask if the 
theory is useful. 

To be honest, we admit that SST does not have much practical use at least in its 
present form. As we have mentioned in section 1.3.1(e)[ for example, we cannot get any 



information about transport coefficients (linear or nonlinear) from the present form of 
SST. The present SST only deals with the response of a system at a fixed "degree of 
nonequilibrium." As for the SST entropy, we do not expect it to play a significant role 
like its equilibrium counterpart. This is because we do not have (and do not expect to 
get) a natural operational definition of adiabatic operations for nonequilibrium systems. 
(But see [2] for an attempt.) 

We believe that the significance of SST should be sought in more conceptual and the- 
oretical aspects. First of all, the mere fact that there exists a consistent thermodynamics 



53 But see 3 for a sever criticism about the use of semipermeable membrane. 

54 A typical example is the delicateness about contact between nonequilibrium states and equilibrium 



states as discussed in section [7] 



57 



for a large class of nonequilibrium steady states (if true) must be regarded as news of fun- 
damental importance. It shows that nonequilibrium states are not generated arbitrarily 
by time evolution, but are subject to a strict thermodynamic structure. More importantly 
from a practical point of view, establishment of thermodynamics can be a first important 
step toward a construction of statistical mechanics for steady states. We believe that such 
a statistical theory will not only of great theoretical interest but will have many practical 
applications. 

A Weak contact, density fluctuation, and linear re- 
sponse in a sheared fluid 

In the present appendix, we discuss a particular scheme for making two subsystems of 
sheared fluid into contact, and examine some of the conjectures of SST. Analysis presented 
here is limited to the first and the second stages of SST (see Section IB~T]) . developed in 
Sections El to El where we dealt with thermodynamics with a "fixed degree of nonequi- 
librium." Based on some plausible assumptions, we can confirm our predictions about 
the density fluctuation stated in section 16.21 We can go further to discuss linear response 
theory and a determination of the "nonequilibrium temperature." 

Compared with another "existence proof of SST" for the driven lattice gas presented 
in the next Appendix the present approach is more heuristic. Nevertheless, the present 
setting has a clear advantage of being much closer to realistic systems. We hope that the 
results in the present Appendix and the next Appendix [B] play complementary roles in 
reinforcing the logic of SST developed in the main body of the paper. 

A.l Weak contact scheme 

Consider a system as in Fig. (a) in which a sheared fluid is separated into two parts by a 
horizontal wall. Both the lower and the upper parts have volume V and are characterized 
by the same "degree of nonequilibrium" (i.e., shear force) r. Following the strategy of 
section 15.21 potential which is equal to u\ and u 2 in the lower and the upper parts, 
respectively, is applied. We assume that the lower and the upper parts are separately 
in nonequilibrium steady states with densities p\ and p 2 , respectively. 

The horizontal wall has a window on it, which opens for a finite interval of time. We 
assume that the size of the window is much smaller than that of the wall, but is much 
larger than the molecular scale. Likewise the interval during which the window is open 
is much shorter than the relaxation time of macroscopic quantities, but is much longer 
than the molecular time scale. By j we denote the amount of fluid that passes through 
the window from the lower part to the upper part during the interval that the window is 
open. 

After the window closes, we keep the system as it is for a sufficiently long time so 
that the two parts reach their steady states with the new densities p[ — pi — (j/V), and 
P2 = P2 + U/V), respectively. 

We repeat many times the above procedure of (short) opening of the window followed 
by a (long) relaxation period. Then there takes place a very slow exchange of fluid between 



58 



(a) (b) (c) 




Figure 19: The scheme of weak contact for a sheared fluid. The upper and the lower 
parts are separated by a horizontal wall which has a small window in it. (a) Both 
the lower and the upper parts are in their steady states, (b) The window opens for a 
finite interval of time, allowing some fluid to move. We denote by j the total amount 
of fluid that have moved from the lower to the upper part, (c) The window closes, 
and again both parts settle into their steady states with new densities. We repeat 
this process many times and discuss the balance between the two parts, density 
fluctuation, and linear response. 

the lower and the upper parts of the system. This process of exchange may be described 
as a discrete time Markov process where the state is characterized by the densities (pi, P2) 
of the two parts. By analyzing this Markov process, we can examine the construction and 
the predictions of SST. 

The main motivation for devising this weak contact is that nonequilibrium steady 
states generically develop spatial long-range correlations (see section I8.3.2J) . which lead 
to anomalous density fluctuation and transport. Since our basic strategy in the present 
work (see section 18. 3. 3 J) is to characterize the steady state in each system by examining 
the contact, the long range correlation between the two parts introduces unnecessary com- 
plication. By separating the two parts by a wall and allowing the exchange of fluid only 
via the small window during a finite interval, we can inhibit the system from developing 
long range correlations between the upper and the lower parts. (Of course long range 
correlation within each part is developed.) 

Now we shall make some plausible assumptions about the behavior of the quantity j, 
the amount of fluid that have moved in a single opening. The most important assumption 
is that j is a random quantity whose behavior is determined solely by local properties 
of the nonequilibrium steady states at the both sides of the window. This is quite likely 
since the small window is open during the time interval which is much shorter than the 
relaxation time. An important consequence of this assumption is that the behavior of j 
essentially does not change when one increases the total volume V of the system (fixing the 
size and the opening interval of the window). This means that the change of the density in 
a single step, which is j/V , is proportional to V~ x . Thus j/V can be made much smaller 
than the change of the average density in response to a change of potential, and than the 
typical magnitude of the density fluctuation in a steady state (since the former change is 
independent of V, and the latter fluctuation is proportional to V~ 1 ^ 2 ). We shall make use 
of this smallness of j / V repeatedly in what follows. 

To simplify the notation, we write the potential difference as Am = w 2 — Mi, and write 
the densities in the lower and the upper parts as p\ = p — 9 and p 2 = Po + 9, respectively. 
Here po is the total density, i.e., the total amount of fluid divided by the total volume. 
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From now on we shall always describe the densities in the two parts using the deviation 9. 

When Au and 9 are given, we denote by ipAu^U) the probability density for the 
variable j. We assume that tpAu,e(j) is independent of the volume V. We have omitted 
the dependence on T and r since these variables are always fixed. 

When Am = and 9 = 0, the two parts of the system are completely identical. Thus 
the corresponding probability density V'o.oC?) is an even function of j with a peak at j = 0. 
We assume that ipo,o(j) decays rapidly for large and is normalized as J dj ipo^U) = 1- 

When 9 ^ 0, i.e., when the densities become uneven, the probability density tp becomes 
asymmetric. In the lowest order, this effect may be written as 

^JV(O,0)^,oO') exp[-a 6j), (A.l) 

where a® is a certain constant, and M{0, 9) is the normalization constant. When there is 
a difference Am = w 2 — u\ in the potential, this is further modified as 

ipAuAj) - A/"(Au, 9) ^ ,o(j) exp[-« 9 j - ^Auj], (A.2) 

again in the lowest order. Here /? is a certain constant, which can of course be identified 
as an inverse (effective) temperature. Again the constant J\f(Au, 9) is chosen to ensure 

J dj ifj A u,e(j) = 1 - 



A.2 Balance condition and the chemical potential 

Suppose that we apply a small potential difference An = u 2 — U\ to the system, and 
repeat the process of opening the window sufficiently many times to have a steady balance 
between the lower and the upper parts. Since the balance is attained when ipAu,e(j) is 
symmetric in j, we get from (jA.2|) that 

a 9 = -^Au. (A.3) 

Since the definition (|5.3|) of the chemical potential implies 

Au = u 2 - Ul = u(p -9)- u(p + 9) ~ -29 u'(p ), (A.4) 
we can represent the derivative of the chemical potential as 

M'(po) = j- (A.5) 

We note that when the two parts are in balance with each other, mechanical balance 
as we discussed in section 15.31 also holds. This is because the window is sufficiently large 
and opens for a sufficiently long time for hydrodynamics to be efficient. Consequently, the 
chemical potential expressed as ()A.5j) satisfies the Maxwell relation ()5.4)1 along with the 
pressure p(p) defined from mechanical forces. 
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A. 3 Density fluctuation 

We shall analyze the density fluctuation in the steady balance condition that we have 
characterized, and derive the conjectured Einstein's formula ([6.9)1 . 

We fix the potential difference Am = 112 — Mi, and describe the densities in the lower 
and the upper parts as p\ = po — an d P2 = Po + 9, respectively From the balance 
condition (jA.3|) . we see that the most probable value of the density deviation is given by 

*o = (A.6) 

To describe the fluctuation around #0, we denote by p(0) the stationary probability 
density that densities in the two parts are po — 6 and po + respectively. The stationary 
probability is the unique solution of 



p(0) = J d9'p{9') c{9' 0), (A.7) 

for any 0, where 

c{e^6 + ^)=Vi; Au ,e(j) (A.8) 
is the transition probability density. It is normalized as 

d6' c{6 -»• 6') = 1. (A.9) 



The condition ()A.7|) is the continuous state- variable version of ([2.24)1 . 

As we shall see below, the solution of (|A.7|) can be obtained by assuming the detailed 
balance condition (see section l2*.H.2j) 

p{9)c{9 ^9') =p{9')c{9' ^9), (A.10) 

for any and 0'. Clearly (jA.lOJ) along with (|A.9|) implies (JA.7[1 . but not vice versa. 

If we substitute 0' = 9 + (j/V), (fA~8jl . and (fA~2jl . the detailed balance condition (fA~Tojl 
becomes 

p(9)Af{Au,9) exp[-a 9j -^Auj] 

= p(0 + AT(Am, + 1) exp[a + pr) J + f A« j]. (A.ll) 

We then have 

, fl TTITTSS - exp[2a o j + /? Am j], (A. 12) 

p(0 + (j/V)) 

where we have used the smallness of j/V to neglect j 2 /V in the exponential and set 
Af(Au, 9 + (j /V))/J\f(Au, 0) ~ 1. By taking the logarithm and again noting that j/V is 
small, we get 

- £ — logp(0) ~ 2« o 0j + /? Am j, (A.13) 
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which can readily be solved to give 



p{9) oc exp[-a V{6- 9 ) 2 } = exp[-/V(po) 



(AN) 2 
V 



(A.14) 



where AA" = (9 — 6q) V is the deviation measured by the amount of fluid. This is nothing 
but the Einstein's formula (|6.9p . expanded to the lowest order in AA^. 

A. 4 Linear transport 

We finally treat time-dependent linear transport through the weak contact, and prove the 
corresponding fluctuation-response relation. This is especially useful since the resulting 
relations can be used to determine the parameter (3 in (|A.2|) by using measurable quantities. 
See Section lA~5l 

It may appear surprising that one can deal with transport phenomena in a highly 
nonequilibrium system. In this case, however, we are dealing with a very weak flow in the 
direction orthogonal to the (strong) shear flow. This enables us to treat the transport by 
using only elementary techniques in Markov processes. 

Suppose, for simplicity, that the two parts have been in a steady contact with vanishing 
potential difference Am = w 2 — Ui — 0. At an instant, we apply a nonvanishing but small 
potential difference 55 Am. Then there takes place a relaxation from a nonequilibrium 
steady state with Au = to another nonequilibrium steady state with nonvanishing Am. 

Let us define the single-step time evolution operator by 



where we have explicitly labeled c(9 — > 9') (defined in (|A.8|) ) with the potential difference 
An. The probability density after M openings of the window is given by 



where the contribution from the normalization factor has been determined by noting that 
J d9co(9' — > 9) = J d9cAu{9' — > 9) = 1. To proceed we need to work on the third term in 
the right-hand side of (jA.17|) . By writing 6" = 9' + (j/V), the relevant integral becomes 




(A.15) 



PM(9) = [(f Au ) M Po ](9), (A.16) 

where po(9) is the stationary distribution for the case Am = 0. 

We wish to express T& u as a perturbation to T . As for the transition probability, we 
find from (lA~8|) and (lA~2l) that 






It is also easy to treat time-dependent perturbation as we shall do in section TB. 61 
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where the final approximate expression is obtained from (|A.8|) . (|A.2|) . and a new (but 
plausible) assumption that f/Vofj) oc exp(— j 2 /{2(j ) 2 })- Here j > is the typical value 
for the quantity j. We now note that 9 and 9' differ only by O(jo/V). Therefore (|A.18|) 
implies that one can replace 9' by 9 as 

d9" (9" - 9') V c (9' -> 9") = J d9" (9" -9)V c (9 -> 9") + 0( a °^ ), (A.19) 

where the difference is so small for large systems that we shall neglect it from now on. By 
substituting the replacement (jA.19|) into (jA.17|) . we have 

cau(9'^9) = Co (9' ^9)-^Au(9-9')Vc (9' ^9) 

+^Au J d9"{9" -9)Vc (9 ^9")+0((Auf). (A.20) 

By substituting (lA~20l) into (|A.15|) . we get 

[f Au p](9)~[f p](9)-^ J d9'(9-9')V{p(9')c (9' ^ 9) + p(9) c (9 ^ 9')}. (A.21) 

When applied topo{9), the stationary condition [T po}(9) = po{9) and the detailed balance 
condition (|A.10|) makes the expression (|A.21|) much simpler as 

[TauPo}(0) - Po(0)-PAu J d9>(9-9')Vp (9')c (9> ^9) 

= po(9)-(3Au[] Po ](9) (A.22) 
We have defined the operator j by 

[]p](9)= [ d9'(9-9')Vp(9>)c (9'^9), (A.23) 



which counts the total amount of the fluid that have moved and at the same time generates 
a single-step time evolution. 

By substituting (|A.22|) into (jA.16|) . and expanding in Au, we find 



M-l 



Pm(9) = Po (9) - (3 Au ]T [(To)™ ho] (9) + 0((Au f). (A.24) 



m=0 



This is our basic equation for the linear response theory. 

Let A?!^) = (p — 9)V be the total amount of fluid in the lower part. We denote 
its average after M openings of the window as (A\(M)}a u = / d9 Ni{9)p M {9). Here 
(Ni{M))& u , as a function of M, describes the relaxation phenomenon after the potential 
difference Au was turned on. By using (jA.24J) . we find that 



Af-l 



(A > i(M)) Au = N o -PAuJ2Ni(0)[(To) m JPo](O) + O((Au) 2 ) 

m=0 

M-l 

= N -(3AuY,(MM)j(M-m)) + O((Au) 2 ), (A.25) 



m=0 
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where N Q = V po = f d6N\{6) po(8) is the amount of fluid in the lower part in the 
steady state with Au = U\ — w 2 — 0- The definition of the temporal correlation func- 
tion (iVi(M) j(M - m)) can be read off from (jA.25|) . 

Reflecting the fact that j measures the amount of fluid moved from the lower to the 
upper part, (jA.25|) can be further rewritten in the form 

(MM)) au = N + (3Au (iV^M) {N^M) - iV 1 (0)}) Q + 0((Au) 2 ). (A.26) 

Thus the relaxation phenomenon is fully described (in the lowest order in Am) in terms of 
the temporal correlation function in the steady state without a potential difference. This 
means that one can unambiguously determine the inverse temperature j3 by measuring the 
behavior of the variable N\. 

A. 5 Discussion 

In the present appendix, we have devised a weak contact realized by a small window 
in the setting of a sheared fluid. Based on plausible assumptions about the exchange 
of fluid through the window, we were able to recover the conjecture of SST about the 
density fluctuation. We were further able to show the fluctuation-response relation for the 
time-dependent relaxation phenomena. 

It is crucial that we have discussed three different settings and the corresponding mea- 
surements, namely, to measure i) the most probable densities when a potential difference 
is applied ( section |A.2|) . ii) the density fluctuation for a fixed potential difference (sec- 
tion and iii) the relaxation phenomena (section I A. 4)1 when a potential difference is 
suddenly applied. 

From i), we get information about /i'(p), and, from ii), we get /3/i'(p). These two 
already give nontrivial prediction to experimental results provided that the parameter (3 
can be identified as the inverse temperature. This is what we expect most naively, but 
there is a possibility that (3 should be regarded as the nonequilibrium inverse temperature 
which deviates slightly from its equilibrium counterpart (see section 18.3.1)) . In such a 
case, iii) provides a definite operational method for measuring the "nonequilibrium inverse 
temperature" f3. Thus the three measurements proposed in i), ii), and iii) together form 
a complete operational test about the validity of (a part of) SST. 

It is quite interesting whether the present weak contact scheme can be applied to 
systems other than the sheared fluid. Strictly speaking the present argument works when 
there is a symmetry between the two parts. Thus it can be applied directly only to 
systems with a symmetry such as the (T, 0; V, N) formalism of electrically conducting 
fluid. It would be very useful if similar scheme can be developed in more general systems. 
Needless to say, a major remaining challenge is to devise similar realization of the p-wall 
contact that we have discussed in section [7| For the moment this problem seems quite 
delicate, and we have concrete results only in the driven lattice gas (see section IB~T]) . 
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B SST in the driven lattice gas 



In the main body of the paper, we have developed the framework of steady state ther- 
modynamics (SST) from a macroscopic phenomenological point of view. In the present 
Appendix, we will develop a microscopic point of view, and demonstrate that SST can be 
realized in nonequilibrium steady states of a standard Markov process called the driven 
lattice gas. This provides a complementary analysis to the "mesoscopic" approach devel- 
oped in the Appendix [XJ The argument here is quite general and can be extended to a 
much larger class of Markov processes. 

With this "existence proof" we can be sure that our framework of SST is theoretically 
consistent. Moreover concrete mathematical results in the driven lattice gas may give us 
hints for further development of our phenomenology. 

Here we introduce the driven lattice gas, and realize a weak contact to determine 
the chemical potential, the pressure, and the free energy. We get general formulae for 
these thermodynamic quantities, which allow us to compute them explicitly (by using, for 
example, a computer or a systematic expansion). We also present results of the simplest 
calculation in the limit of high temperature and low density. 

We stress that we are not defining these thermodynamic quantities based on formal 
analogies with the equilibrium statistical mechanics, but rather defining everything based 
on the operational procedures discussed carefully in section Therefore our free energy 
F is (at least for the moment) not related to a statistical quantity through a relation like 
F = -(1/(3) log Z or S = k B log W. 

We also show that the fluctuation relation (see section 16 .2|) and the minimum work 
principle (see section 16.3)1 hold exactly in these models. We argue that an ideal /x-wall 
(see section 17.2)1 may be constructed for the driven lattice gas. We can go further to 
develop a linear response theory for time- dependent particle exchange process through 
weak coupling (see section IA~4|) . 

As is clear from the summary in the above paragraphs, we can reproduce most aspects 
of our phenomenological construction. 

Remark: If one applies the construction in the present Appendix to a Markov process whose 
stationary distribution corresponds to an equilibrium state, then we get thermodynamic 
quantities which exactly coincide with those obtained from equilibrium statistical mechan- 
ics. This fact alone is of some interest since our derivation involves only local correlation 
functions, nothing analogous to the partition function. One may regard our construction 
as a robust method of "getting thermodynamics without a partition function" , which can 
be applied to nonequilibrium steady states as well as equilibrium states. 

B.l Definition 

Let us define the driven lattice gas. It belongs to a class of models which are obtained by 
making minimum modifications to Markov processes for equilibrium dynamics discussed in 
section l2~!fl As we have stressed in sect ion 12 .3 .21 the detailed balance condition (|2.25[) with 
respect to the equilibrium state is a fundamental requirement for constructing physically 
meaningful models for equilibrium dynamics. Unfortunately we still do not know what 
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Figure 20: Basic setup of lattice gas models. Particles live on sites of the £ X h two 
dimensional lattice. Particles hop around the lattice according to given transition 
rates. 



are corresponding guiding principles in nonequilibrium stochastic dynamics. This means 
that we must proceed carefully, not over-trusting results from model studies, and always 
questioning robustness of conclusions. 

For simplicity we treat models in two dimensions, but extensions to higher dimensions 
are automatic. Define an I x h lattice A by 

A = jx = (zi, x 2 ) | x x = 0, ±1, ... , ±^y^, x 2 = 0, ±1, . . . , ±^y^} , (B.l) 

where (as usual) x\ and x 2 are the horizontal and the vertical coordinates, respectively. 
Lattice sites are denoted as x, y, . . . € A. We impose periodic boundary conditions (i.e., 
we identify xi = {£ + l)/2 with xi = -{£-l)/2, and x 2 = {h+l)/2 with x 2 = -(/i-l)/2). 
For each site a; 6 A, we associate an occupation variable r\ x . We set T] x = 1 if the site x is 
occupied by a particle, and T] x = if x is empty. We do not allow more than two particles 
to occupy a single site. See Fig. OH 

We denote a collection of r] x for all x G A as 

1 = (v*)*eA, (B.2) 

and call it a configuration. A configuration 77 corresponds to a microscopic state s in 
sections 12.21 and 12.31 For a given configuration 77, we write 



\ r l\ = ^2 T l*> (B-3) 



xeA 

which is the total number of particles in rj. 

The Hamiltonian H\(-) gives the energy H\{rf) for a configuration 77 on the lattice 
A. Although our discussion does not depend on the specific choice of -^a(') (except in 
section IB.8|) . let us take for concreteness the Ising Hamiltonian 

Ha(t)) = ~JJ2 Wv, (B.4) 

where J is the coupling constant, and the sum is over all pairs of nearest neighbor sites 
(according to the periodic boundary conditions). Although the symbol J is used to denote 
the flux in the main body of the paper, we here follow the standard notation in the driven 
lattice gas. 
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For a site x G A and a configuration 77, we denote by rj x the new configuration obtained 
by changing 56 the value of i] x in r/. More precisely, we set 

(0.= {;,;"* m 

Similarly for x,y £ A and a configuration 77, we denote by T7 a,,y the configuration obtained 
by changing both rj x and r\ y . 

We can define a Markov process using the general discussion in section 12.3.11 once we 
specify the transition rates c A ' '{rj — > rf). For any configuration 77 and any s,j/gA such 
that \x — y\ — 1, we set 

cT'^iv^rj^) = V*(l ~ Vv) <l>[P{HA(ri x ' y ) - H A (r!) + E( Xl - yi )}\ 

+ (1 - njrjy <j>[(3{H K {r) x *) - H\(rj) + E{y x - x x )}\, (B.6) 

where (3 = 1/(/cbT) is the inverse temperature and E is the "electric field" in the x\ 
direction. Here 4>(h) is the function introduced in section 12.3.11 and again satisfies (J2.28|) . 
The first term in the transition rate (|B.6|) represents a hop of particle from x to y and 
the second term from y to x. We set cf' E \rj — > rj') = for 77, r] f not of the form (jB.6|) . 
Note that the particle number \r)\ is conserved in the allowed transitions. 

A Markov process with the transition rates (|B.6|) is ergodic (see section 12.3.1)1 in a 
state space with a fixed \rj\. Thus for each positive integer < £h, there is a unique 
stationary distribution p^'^iv) which is nonvanishing only when \tj\ = N. When E 7^ 0, 
this stationary distribution represents the nonequilibrium steady state of the system. We 
denote the average over the steady state distribution as 

(gWtff = JX^pSffa), (b.7) 

where g{rj) is an arbitrary function of configurations. 

In the steady state of the present driven lattice gas, there is a constant flow of parti- 
cles toward the right. In this sense the model has some resemblance with the (T, 0; V, N) 
formalism of electrical conduction. See section fO} especially Fig. ED (b). Note that we 
do not have electric plates here, which are effectively replaced by the periodic bound- 
ary conditions. Since the parameter E corresponds to electric field, we can identify the 
nonequilibrium intensive variable as = EC.. For convenience, however, we shall use the 
parameter E (which may also be regarded as an intensive nonequilibrium variable) to 
characterize the steady states. 



B.2 Local detailed balance condition 

Take any x, y e A such that \x — y\ = 1, and let r] be any configuration such that r] x = 1 
and rjy = 0. Then the definition (|B.6|) and the condition (|2.28J) for <p(h) implies 

Sm^^l = ex vW H ^) ~ H A (r, x >y) + E( Vl - a*)}], (B.8) 

4 j (77^^77) 



5d 



Since % = 0, 1, the change means — > 1 or 1 — > 0. 
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Figure 21: Weak contact of two steady states in a lattice gas model. Potential which 
is equal to u% and u 2 on the lattices Ai and A2, respectively, is applied to the system. 
The potential only modifies the transition rates between the two lattices. By using 
this setting we can define the chemical potential of a lattice gas model. In fact the 
same setting can be used to realize a perfect /x-wall that connects a nonequilibrium 
steady state with an equilibrium state. See section IB. 71 

which should be compared with the detailed balance condition (j2.26|) in equilibrium dy- 
namics. It must be noted that there is no single function 57 H(-) which enables us to 
express the right-hand side of (jB.8|) simply as exp[{H(r]) — H(rj x,y )}]. Try, for example, 
H{rj) = H A (rj) - E^ x&K x x r) x . Then (JHSJ) is equal to exp[f3{H(ri) - H(ri x ' y )}] for most 
x except for those at boundaries. For any x G A one can choose a H(-) which covers sites 
around x, but not the whole lattice. In this sense, the relation ( |B. 8)1 is sometimes called 58 
the "local detailed balance." 

B.3 Determination of thermodynamic quantities 

We will see how we can realize the weak contact of two systems, and evaluate thermody- 
namic quantities. 

B.3.1 Weak contact in lattice gases 

We shall now realize in the context of lattice gases the idea of weak contact. 

Let Ai and A 2 be I x h lattices identical to A of ()B.1|) . (It is automatic to extend the 
present discussion to cases where Ai and A 2 are not identical.) We denote by 77 and £ 
lattice gas configurations on Ai and A 2 , respectively. The total Hamiltonian is 

Ht' U2 \rj, = flAxfa) + #a 2 (C) + UiM + U2ICI, (B.9) 

where Hjy.(-) (i = 1,2) are copies of the Hamiltonian H\(-), and u± and u 2 are uniform 
potentials applied to A x and A 2 , respectively. Note that such a potential does not affect 
the dynamics within Ai or A 2 at all, and only modifies hopping between the two lattices. 
Our Markov process is defined by the transition rates c^' E ' ) (77 — > rj x,y ) and (£ — > 

£ x,y ) (which are faithful copies of c^ ,E \r) — > r] x,y ) of (|B.6p ) within each sublattice, and 
additional transition rates for hops between the two sublattices Ai and A 2 . 

57 If there was one, we could write the steady state distribution as p S s(v) = gx p[— PH(r))], and the 
Markov process would satisfy the detailed balance condition with respect to p ss (r]). 

58 The term "local detailed balance" might be a bit confusing. A detailed balance condition, as in Q2.25|l . 
is always stated with respect to a particular stationary distribution. Here one still does not know what 
the stationary distribution is. A condition like l|B.8(l may be better called "local energy conservation." 
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Figure 22: A system consisting of two states 1 and 2 which are separated by a large 
energy barrier W. By examining equilibrium dynamics that satisfies the detailed 
balance condition, we can determine the transition rates c(l — > 2) and c(2 — ► 1). 



Let us pose here and examine how one should design transition rates for two subsystems 
that are coupled very weakly. Here we assume that the weak coupling is realized by the 
presence of a very large energy barrier for transitions between the two subsystems. For 
simplicity let us first consider a system with two states 1 and 2 with the energies E\ and 
E 2 , and assume that the two states are separated by an energy barrier W ^> E\,E 2 . See 
Fig. 1221 We shall construct a Markov process describing the equilibrium of this system. 
Suppose that the system is in the state 1. In order for the system to jump into the state 2, 
it must first reach the top of the energy barrier, raising the energy by W — E\. Since there 
is no cost required for falling down into the state 2, we may assume that the transition 
rate from the state 1 to 2 is fully determined by the relative height W — E\ of the wall. 
This means that we can write c(l —>■ 2) = ip(W — E{) with some function ip(h). Similarly 
we have c(2 — > 1) = ip(W — E 2 ) for the opposite transition. By requiring the detailed 
balance condition (|2.26|) 

c(2-l) iP(W-E 2 ) ' ^ iUJ 

we find that the only possible choice is ip(h) = ce~@ h with some constant c. Thus we find 
that 

c(1^2) = ee? El , c(2^ 1) =ee pE \ (B.ll) 

with e = ce~^ w . Note that the assumption of very high energy barrier led us to the 
essentially unique choice of the transition rates 59 . 

Now we come back to the task of realizing a weak contact between two sublattices of 
driven lattice gas defined on A 1 and A 2 . We assume that, for each j = 0, ±1, . . . , ±(£— 1)/2, 
a particle can hop between the site 60 (j, 0) in A 1 and the corresponding site (j, 0) in A 2 . 
We also assume that the particle must go over a very high energy barrier to execute such 

59 Also note that the rates used here do not fit into the general form assumed in section 12.3. II 
60 Note that both the sites are in the bulk of each subsystem since we impose periodic boundary con- 
ditions. We have chosen this definition since our main purpose is to characterize bulk properties of 
nonequilibrium steady states rather than to investigate properties of realistic contact. See section f8. 3 .31 
In equilibrium, the second law guarantees that it does not make any difference (in macroscopic scale) 
whether one puts boundary sites or bulk sites into contact. We still do not know whether nonequilibrium 
steady states possess similar robustness. 



69 



a hop. Then we see that the transition rates should be of the form (|B.11[) . where E±, Ei 
should be interpreted as local energies. Then we get 61 

+e (1 - r]*)(* exp[P{H A2 (C) - H A2 (C) + u 2 }), (B.12) 

for x = (j, 0) with j = 0, ±1, . . . , ±(l- l)/2. We set c[(ry, C) -> (r/, C')] = for configura- 
tions not of the form ()B.12|) . The first term in (jB.12|) represents a hop from A x to A 2 and 
the second term from A 2 to Ai. Note that we do not have terms involving the electric field 
E in (jB.12|) since we imagine that particles hop in the direction orthogonal to the field. 
Indeed for any nonvanishing c[(r), £) — > (r] x , £ x )} we have the detailed balance condition 
(see (gHU) ) 

4(rjX) -> (r) x ,C)} _ _ rarir (« iw ]/ - tt(«i,« 2 )/ 



c[fa-C)->faC)] 



exp^iC^^O - ^t' U2; (^,r)}]- (B.13) 



We investigate the steady state of this model with the total particle number |»7| + |C| — 
2N where AMs a constant. When e = 0, the two sublattices decouple, and hence the 
distribution p A '^ (17) Pa 2 'jv 2 (0 with any fixed iVi, A" 2 such that A"i+A^ 2 = 2A" is stationary. 
We want to see how this situation is modified in the lowest order of e > 0. 

In the limit e — > 0, where particle exchanges between Ai and A 2 are infinitesimally 
rare, the states within A x and A 2 first reach their steady states. When a particle hops 
between Ai and A 2 , again the states in the two sublattices relax to the steady states with 
the new particle numbers. Such a separation of time scale enables us to study stochastic 
dynamics of particle exchange between Ai and A 2 separately from the relaxation process 
in each sublattice. 

We fix the total particle number 2N, and denote by N% the number of particles in 
Ai- Since the number of particles in A 2 is automatically known to be A" 2 = 2A" — N\, we 
only specify N\ in what follows. Since a hop between the two sublattices takes place in 
the distribution p A ^ 1 (17) Pa^'jv 2 (C)) t ne effective transition rate for a hop from Ai to A 2 is 
obtained by averaging the sum of the rates (fRT2jl as 

c{N x - N x - 1) 

{t-X)/2 \ (T ' S) 

E %-,o)(l-Ca,o))c[(r,,C)-(^' 0) ,C '' 0) )] 

\i=-(^-l)/2 / Ai,JVi;A2,JV 2 

(£-l)/2 

= e E (Vmi 1 - Cm) exp[P{H Al (rj) - H Al (r,^) + «i}]>™ ; a 2i at 2 >( R14 ) 
j=-(e-i)/2 

where the average is taken over Pal'jvi^) Pa^'aI(C)- By noting that the average separates 
into those for each sublattice, and using the translation invariance, we find 

c(N t - N x - 1) = et (1 - ^) gf(iVi) e^ 1 , (B.15) 



61 Going back to the definition l|B.5jl of r] x , one sees immediately that the values (which can be or 1) 
of rj x and (, x are simply exchanged in the process (77, £) — > (r/ 31 , no matter what 77 and £ are. 
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where V = £h and 

g(N) = ( Vx exp [(3{Ha(v) ~ H A (r, x )}})£f = (rj x exp[-(3J ]T rj v ] )gf , (B.16) 

y;\y-x\=l 

where we substituted the Hamiltonian (jB.4|) . Here x is one of (j, 0), but it can actually 
be an arbitrary site in A because of the translation invariance. 
Similarly we have 

c(Nx -+N 1 + l)=e£(l-^) g(N 2 ) e? u \ (B.17) 
for a hop from A 2 to A x . 



B.3.2 Chemical potential of lattice gases 

To find the chemical potential let N\ and N 2 be the average particle numbers in the steady 
state of the whole system. Since hops between the two sublattices balance with each other, 
we can assume that 

c{N x -> N\ ~ 1) = c(Ni - 1 -> Ni). (B.18) 
Then by using (|B.15|) and (|B.17[) . we get 

l , g(Ni) l , g(N 2 + l) , 

-log +m = -log yv 2 J ! +u 2 . B.19 

P \-{N x -l)/V P 1-N 2 /V y 1 

By comparing this equality with our definition (J5.3|) of the chemical potential, we are led 
to define 

> , 1 glpth) 1 , g(plh) 

where p = N/(£h) is the density We assume that fj,(p) defined by ()B.20j) has a sensible 
infinite volume limit £, h — > oo (i.e., V — > oo). Then (|B.19|) precisely coincides with the 
desired balance equation (|5.3j) . 

Recalling the definitions ()B.16|) of g(N), we stress that we have obtained a concrete 
formula (|B.20|) for the chemical potential which involve expectation values in the steady 
state. Therefore one can in principle compute p(p) = p(T, E; V, N) by using system- 
atic approximations or a computer. See section IB.8I Note that our formula ()B.20jl for 
the chemical potential involves correlation functions of only local quantities. Therefore 
it is not affected by the long range power law correlations which are found universally in 
nonequilibrium steady states of lattice gases. This can be clearly seen in our perturba- 
tive calculation in section IB.81 See section 18.3.21 for more discussions about long range 
correlations. 

Note also that in ()B.20|) we have written down p(p) without any ambiguities. To be 
precise, the relation (|5.3|) only determines the p dependence of the chemical potential. So 
there is a freedom to add any function po(T, E) to (jB.20|) . But the simplicity of the formula 
(|B.20|) suggests that this is the "right" choice. Indeed a consideration about //-walls in 
section lB.71 indicates that ()B.20|1 is the complete formula for the chemical potential. 



71 



Figure 23: The setting used to determine the pressure in the lattice gas. By changing 
the potential u applied to the smaller subsystem from to oo, we can effectively 
reduce the volume (area) of the system by th. From the mechanical work required 
to perform this change, we define the pressure. 



B.3.3 Pressure of lattice gases 

We shall define pressure for the driven lattice gas. Since lattice gas models do not have the 
notion of momentum, the standard definition in terms of mechanical forces do not apply. 
Instead we here obtain pressure from the mechanical work required to change the volume 
(area). 

We consider two lattices with the same width I and different heights h and h. We 
assume h ^> h. We place the smaller lattice on top of the larger one, and put them into 
a weak contact with each other as in Fig. We apply a uniform potential u only to the 
smaller subsystem, and keep T and E constant over the whole system. 

We first set u = and let the whole system reach its steady state. Since the conditions 
are the same everywhere, we get a uniform local steady state with density p over the whole 
system. Then we slowly vary u from to oo. When u = oo, there are no particles in the 
smaller subsystem, and we have a uniform local steady state with T, E and the density 
p{l + (h/h)} ~ p in the larger subsystem. 

Let p(u) be the density in the smaller subsystem when the potential is u. By the 
balance condition (|5.3|) . this density can be determined by 

Mp) =p(p(u))+u, (B.21) 

where we set the density in the larger subsystem to p. This is allowed since the deviation 
is of order ph/h, and we can make h/h as small as we want. By differentiating (jB.21|) by 

u, we get 

^ = ~ A vT- (B-22) 

Now we evaluate the mechanical work required to change the potential u. Since the 
total number of particles in the smaller subsystem is p(u) I h, the work needed to change 
the potential from u to u + Au is equal to AW = Au p(u) £h+ 0((Au) 2 ). The total work 
is obtained by summing this up as 

poo 

W = £h dup(u) = £h dppp'(p), (B.23) 
Jo Jo 

where we used flB.22|) to change the variable. 
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Defining the pressure p by the standard relation W = pAV with AV = £h being the 
volume (area) of the smaller subsystem, (|B.23|) implies 

p{p)= [ P dppt/(p), (B.24) 
Jo 

which is the final formula of pressure in the lattice gas. Note that the Maxwell relation 
(I5.4j) is obvious from the formula (jB.24|) . 



B.3.4 Free energy of lattice gases 

Now that we have the formulae for the chemical potential (jB.20|) and the pressure (jB.24|) . 
we use the Euler equation ()6.2|) in the form 

f(p) = -p(p)+pp(p) = f P dpp(p), (B.25) 

Jo 

to define the specific free energy f(p) = F(T, E\ 1, p) = F(T, E; V, N)/V with p = N/V. 
The second equality in (jB.25|) is obtained by using the formula (jB.24|) and integrating by 
parts. 

We have thus obtained concrete formulae for the chemical potential, the pressure, and 
the free energy of a nonequilibrium steady state of the lattice gas. The formulae only 
involve local correlation functions in the steady state distribution, and may be computed 
in a concrete model. 



B.4 Steady state and density fluctuation 

We will now study the steady state distribution of a weakly coupled system and show that 
Einstein's formula (J6.9|) for the density fluctuation holds exactly in the present setting. 
Recall that in equilibrium statistical mechanics, the relation ()6.9|) follows trivially from the 
canonical distribution ( section l2~2~j) . We note that an analogous derivation is never possible 
here since we still do not know anything about general forms of steady state distribution 
in nonequilibrium systems. Nevertheless the same relation can be proved by examining 
the effective stochastic process of particle exchange between the two subsystems. 

Consider again the situation in section lB.3.11 where two identical systems on Ai and 
A2 are weakly coupled with each other. There are uniform potentials U\ and u 2 on Ai and 
A 2 , respectively. 

We are interested in the steady state with the total particle number \r)\ + \C,\ = 2N. 
When £ = 0, the distribution P^'^JAt]) Pa^jv 2 (C) with any fixed Ni, N 2 such that Ni+N 2 = 
2N is stationary 62 . If we take into account the effect of e > in the lowest order, the 
above degeneracy is lifted and we get a unique steady state distribution of the form 

p£^H^C)=^S^ ) (I»iI,ICI)p£S(»i)p2^(C), (b.26) 



62 Recall that P^N^iv) is the steady state distribution for the system on A, and is nonvanishing only 
when |r;| = N. 
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where Pa}^ U 2N 2 \^' -^2) is nonvanishing only when Ni + N 2 = 2N. We again specify only 
Ni, and abbreviate Vxl^rZN^iNii N 2 ) simply as p(Ni). It is the probability of finding N\ 
particles in Ai and 2N — Ni particles in A2, and is normalized as 

X>M = 1- (B.27) 

We will now evaluate p(Ni). 

We substitute the steady state distribution ()B.26|) into the general condition (|2.24j) of 
stationarity, and then take partial sums over r/ and £ with fixed |ry| and |£|. By recalling 
the definition (jB.14|) of the effective transition rate for hop between the two sublattices, 
this gives 

{-c(iVx -> iV x + a) p(A^) + c(A^ + a -> JV X ) p(JVj + a)} = 0, (B.28) 

<r=±l 

for any iV]_. 

To solve (|F3.28jl . we try the ansatz 

p(Ni) = g (Ml) (iVi) q [U2) {2N - Nt), (B.29) 

with a function q( u \N). We also assume that each term in the sum in the left-hand side of 
(|B.28|) vanishes. This is a kind of detailed balance condition. By using (|B.15|) and (|B.17[) . 
we find that this condition is satisfied if 

g(N) qW(N) = (1 - gM(tf - 1), (B.30) 



which means 

N 



gW(AT) = g («)( ) e -/** f[ 1 ^[m)^^ = const - ex P 



M=l 



N M 

M=l 



(B.31) 

where we used (IB.20j) . Note that 

N m r p 

E My) ^ V- / dp>(/5) = V /(p), (B.32) 

M=l ^° 

where we used ()B.25|) and wrote p = N/V. Thus from (|B.31|) and (|B.29|) . we get the 
desired estimate 

PkS»n\ N U N 2 ) = const. expl-(3V{u lPl + u 2 p 2 + f{p x ) + f(p 2 )}}, (B.33) 

where pi = N\/V\ and p 2 = N 2 /V 2 . 

If one sets U\ = u 2 = 0, ()B.33|) becomes 

PMArM^, N 2 ) = const. ex P {-(3{F(T, E; V, N x ) + F(T, E; V, N 2 )}}, (B.34) 
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which is precisely Einstein's formula (|6.9|) for density fluctuation. It should be stressed 
that this is an exact relation, which covers both small fluctuations and large deviations. 
At least in the setting of weakly coupled lattice gases, we have shown rigorously that the 
density fluctuation in nonequilibrium steady states is exactly governed by the SST free 
energy. 

It is easy to extend the fluctuation formula to the case where more than two subsystems 
are weakly coupled with each other. 

B.5 Minimum work principle 

Let us continue and study the steady state distribution in more detail. This will lead us 
to the minimum work principle for steady states. 

By substituting (jB.33|) to the full expression (jB.26|) of the steady state distribution, 
we get the final formula for the steady state distribution 

p£S^(^0 (B.35) 

for T) and C, such that \r\\ + \C\ = 2N, where F(N) is a shorthand for F(T, E;V, N). 
We wrote the (unknown) normalization factor as 63 cq exp[j3 U2)], where Co does not 
depend on u\ and U2- We now investigate the function Q(ui,U2), and show that it is 
nothing but a Legendre transformation of the free energy F(N). 

We fix all the parameters except U\, 112, and denote the average over the distribution 
(IB.35j) as (• • -) U1)U2 . Let us write 

JViKtia) = (|r7|) Ul)U2 , N 2 (u h u 2 ) = (|C|) M - (B.36) 
From the normalization condition 

£ p£5$°fa.<) = i, (B.37) 

(|fl|+|C|=2JV) 

and the expression (|B.35|) . we find 

*{u u u 2 ) = -~ log <e-^^l + "^D) 00 . (B.38) 
By differentiating (|B.38j) . we get 

= N 1 (u 1 ,U2), a = N 2 {u 1 ,u 2 ), (B.39) 

OU\ OU2 

which can be regarded as differential equations for determining <§>{ui,u 2 ). 
We now claim that the solution of ()B.39|) is given by 

2 

$(u 1; u 2 ) = J2i F ( N i(ui, u 2 )) + m Ni( Ul , u 2 )}. (B.40) 

i=l 

63 We may set cq = 1. But with the freedom of adjusting Co, we do not have to worry about additive 
constant in <S>(u\,U2)- 
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To see this, we simply differentiate (|B.40|) by U\ to get 



2 

d$(ux,u 2 ) , s. v-^ 
— B — = N l {u l ,u 2 )+'£ 

i=l 



2 

dN i (u 1 ,u 2 ) r ,Ni(ui,U2). 1 
(M 77 ) + M 



(B.41) 



where we used f|6.4|) . Note that the balance condition ()5.3|) implies that /x(A^(tti, U2)/V) + 
Mi is independent of z = 1,2. Then since iVi (141,1/2) + N 2 (u\,u 2 ) = 2A is constant, the 
second term in the right-hand side of (|B.41|) vanishes. We thus get the first equation in 
(|B.39|) . The second equation follows similarly. 

We have thus determined the steady state distribution (|B.35|) including the normal- 
ization function. The formula (jB.40|) shows that $(ui, u 2 ) is obtained from F(T, E; V, N) 
by a Legendre transformation. 

At this stage we shall see what we get from the general second law of Markov processes 
described in Appendix 

We consider a time-dependent Markov process where the potentials Ui(t), u 2 (t) become 
time-dependent in the present model. The pair (1*1,142) correspond to the parameter a in 
Appendix O The system is initially in the steady state corresponding to (i*i(0), 1*2(0)), 
and we vary i*i(t), u 2 (t) in an arbitrary manner for < t < tf. 

Using (|B.35|) . we see that the function of (jC2j) . which play a fundamental role in 
the second law, becomes 

^ 2) (T7, C) = P{uiW + u 2 \C\ - u 2 )} - logp™°i(r7, C). (B.42) 
Therefore the second law reads 







dt { *^ (|T7|), + ^ (|C|) t \ > $K(t f ),« 2 (tf)) - $(«i(0),« 2 (0)). (B.43) 



Since (\rj\) t and (|C|) t are the number of particles in Ai and A 2 , respectively, the left-hand 
side of ()B.43|) is precisely the mechanical work W needed to change the potentials ui(t), 
u 2 (t). Thus (IB.43|) becomes 

W > $(«i(t f ), u 2 (U)) - $(wi(0), w 2 (0)), (B.44) 

which is the minimum work principle for steady states. Note that $ rather than F appears 
on the right-hand side because we are controlling the potentials u\, u 2 , rather than the 
volume. If we set %(0) = 1*2(0) = and «i(if) = 0, u 2 (tf) = 00, then ()B.44|) becomes 

W > F(T, E; V, 2 A) - 2 F(T, E; V, N) = F(T, E; V, 2 A) - F(T, E; 2V, 2A), (B.45) 

which is precisely of the form ()6.11|) of the conjectured minimum work principle. 

It is an easy exercise to extend the minimum work principle (jB.44|) to the cases where 
n subsystems are weakly coupled with each other. Then one is allowed to change the 
potentials Ui(t), . . . , u n {t) in an arbitrary manner. 

The present minimum work principle, although valid for any Ui(t), u 2 (t), may not be 
too exciting since weak coupling ensures that each subsystem is in a steady state for any 
t. But see the following remark. 
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Remark: The essences of the minimum work principle flB.44|) may be the following property 
that we shall call "weak canonicality." Consider a Markov process for a lattice gas, and 
let poirf) be the stationary distribution for the case where no potential is applied to the 
system. We then apply a potential u(-) to the system and denote the new stationary 
distribution asp u (.)(rj). 

We say that the system has "weak canonicality" for a class of potentials IA if 



Pu(.)(»f) - ex P 



/?$[<)] -pY,< x )n* 



Pod), 



(B.46) 



for any it(-) G U, where the function $[«(•)] ensure the normalization. 
If flB.46|) holds we can easily show a minimum work principle 

^>$M-)]-$M-)L 



(B.47) 



for a time-dependent Markov process where u t {-) varies within U. We can also show the 
expected formula for density fluctuation and a version of fluctuation-response relation 
based on (IB.46I) . 

We therefore regard it an important task to study which models possess weak canoni- 
cality for which classes of potentials. So far we only know of some simple examples. 



B.6 Linear response 

We can also develop a linear response theory for time- dependent phenomena which take 
place when the potentials u±, Ui become time-dependent. As we have already remarked in 
section IA.41 it may not be too surprising that we can study linear transport phenomena, 
since we are dealing only with transport through the weak contact. Nevertheless it might 
be of some importance that a linear response theory in a highly nonequilibrium system 
can be constructed unambiguously. Recent numerical study [S4 indicates the validity of 
the fluctuation response relation in DLG when a weak probing field orthogonal to the 
strong driving field is applied. This finding is similar to the result we present here, but 
(theoretically speaking) is more delicate. 

Since the potential affects only hopping between Ai and A2, we only need to treat slow 
stochastic dynamics of particle exchange. We again fix the total number of particles to 
2 A, and only specify N±, the number of particles in A^ 

For simplicity 64 we set U\ — and u<i = Xh(t), where h(t) is an arbitrary (not too 
pathological) function such that h(t) = for t < 0. A is a small parameter in which we 
shall expand. We denote by pt(Ni) the probability that there are Ni particles in Ai (and 
hence 2N — Ni particles in A 2 ) at time t. It satisfies the master equation 

^Pt(Ai) = J2 i-Pt( N i) ca(Ai -^Ni + a) +p t (N 1 + a) c\(Nx + a ^ N±)}, (B.48) 

<T=±1 

for any t > and Ni, where cx(Nx — > N± + cr) is the transition rate (jB.15|) or (jB.17|) 
with u\ — and u 2 = Xh(t). The initial distribution p (Ni) is taken to be the stationary 

64 Extension to models with varying u\ is automatic. 
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distribution (studied in section IB.4|) with u\ = u<i = 0. We wish to solve (jB.48|) in the 
lowest order of A. 

From (IB~T5|) and (lB~TTJ) . we find that 

c A (JVi JV X - 1) = 5 (iVi - iVx - 1) (B.49) 

and 

c A (^! -»• iVx + 1) = UF\ iVi + 1) e A/3/l(t) 

= co(iVi -^AT 1 + l) + A/3/ i (t)c (iV 1 ->iV 1 + l)+O(A 2 ).(B.50) 

By substituting ()B.49|) and ()B.50|) into the master equation (jB.48|) . we get 

j t p t (N 1 ) = Y,r(N 1 ,N[)p t (N[) 

+A h(t) {-pt{Ni) 5o(iVi - N, + 1) + ^(iVx - 1) CoiN, - 1 - JV X )} + 0(Afa.51) 
where we have defined r(Ni,N[) by 

^ T(iV 1 , iV() g(iV() = ^ {-g(iVi) c (iV 1 -> iVx + a) + + a) ^(JVx + a -> iVx)}, 

JVj <T=±1 

(B.52) 

for any g(-). 

The time evolution operator U t (Nx, N[) for m x = m 2 = is defined as the solution of 
^tft(Wi, iV() = r (Nx, O ^K, (B.53) 

AT" 

with the initial condition Uq(Ni, N[) = 5ni,n'- Then it is standard 65 that the perturbative 
solution of the master equation (jB.51|) is given by 



Jo N> 



x{-p (N[) co(N[ - N[ + 1) + p (N[ - 1) 5 (N[ - 1 - N[)} + 0(A 2 ) 
-p (iVi)-A/3 [ dsJ^Yl Ut-s(N u N[)h(s)ap (N[ + a)co(N[ + a^N[) + 

where we used the detailed balance condition p (N[) c (N[ — > N[ + 1) = po(^i + 1) c (iV{ + 
1 — > N[) to get the final expression. 

65 A quick derivation. Here we write N instead of Ni. Write (fB~5l) as dp t (N)/dt = X^{r(iV, TV') + 
\Xt(N,N')}p t (N) + 0(A 2 ), and write the solution as p t (N) = p + Xq t (N) + 0{\ 2 ). Then by not- 
ing that '^2 N ,T(N ^N') Pq(N') — 0, one finds that qt(N) satisfies the differential equation dq t (N)/dt = 
J2 N ,F(N : N')q t (N') + A X/AT' Xt(N, N') po(N'). It is easy to check that the solution is written as 
q t (N) = f* ds J2 N , iN „ U t „ s (N, N') Xs (N' , N") po (N") . 
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We define the "current operator" by 

j Nl ,Ni = c (N[ - iVO (N[ - iVi), (B.55) 

which measure the number of particle (which number is either 0, 1 or —1) that have passed 
from Ai to A 2 at a given instant. Then the solution (jB.54|) can be written in the form 

p t (N 1 )=p (N 1 )-\(3 I dsJ2 ^- s (iVi,iVO^(s)jiv;,7v»Po(iVn + 0(A 2 ), (B.56) 

which is the basic equation of our linear response theory. 

The average (Ni(t)}\ = ^2 Nl Nip t (Ni) of the number of particles in Ai at time t can 
be evaluated by using (jB.56|) as 




where we noted that the average in the steady state with u\ = u 2 = satisfies iVi po(Ni) = 
N. We can further rewrite ()B.57|) as 

(N 1 (t)) x = N-\/3 f dsh(s)(N 1 (t)j(s)} + O(X 2 ) } (B.58) 
Jo 

where the definition of the time-dependent correlation function (Ni(t) j(s))o may be clear 
by comparing (|B.58|) with (|B.57|) . This is the desired fluctuation-response relation for the 
particle exchange process in the weakly coupled DLG. 

When h(t) is a step function with h(t) = for t < and h(t) — 1 for t > 0, then 
()B.58|) simplifies as 

(A>x(t)) A = N-XP r^(iV 1 (t)j(s))o + 0(A 2 ) 

J o 

= iV + A/5(A> 1 (t){A> 1 (t)-A> 1 (0)})o + 0(A 2 ). (B.59) 
B.7 /i-wall in the driven lattice gas 

Let us comment on how the notion of /i- walls introduced in section l?~T1 can be implemented 
in the driven lattice gas. 

The answer seems to be very simple. The weak coupling scheme of section IB. 3. II 
can be applied to situations where the subsystems on Ai and A 2 have different values of 
nonequilibrium parameters. If we set E = for the subsystem on A 2 , a contact between a 
steady state and an equilibrium state is realized. We may assume that this weak coupling 
realizes a /i-wall. (But see the remark at the end of this section.) 

To see that this defines n(T, E; V, N) consistently (see the discussion at the end of sec- 
tion EHJ, it suffices to show that the formula (|B.20|) gives the standard chemical potential 



79 



for equilibrium states. This fact can be checked directly for general cases, but the easiest 
way is to treat the free system with H\(-) = at equilibrium. Then (jB.20J) gives 

^ = ^T^~ P ' (R60) 

which coincides with the result from equilibrium statistical mechanics. Since it is guar- 
anteed that two systems in a weak contact have the same values of p(p), it follows that 
(IB.20|) gives the equilibrium chemical potential in an arbitrary equilibrium system. 

We therefore conclude that the formula (|B.20|) gives a consistent chemical potential 
/i(T, E; V, N) for a local steady state (T, E; V, N) including its dependence on T and E. 
Similarly the formula (jB.25|) defines the corresponding free energy F(T, E; V, N) without 
ambiguity. 

It should be recalled, however, that we concluded in section 17.11 that a contact be- 
tween an equilibrium state and a nonequilibrium steady state cannot be realized in the 
(T, 4>; V, N) formalism. If we stick onto the interpretation that E represents the electric 
field, we must again conclude that our contact is not realistic. Nevertheless the fact that 
we can construct (at least theoretically) a consistent //-wall may be of importance and 
interest . 



B.8 Perturbative estimate of the SST free energy 

We found that (|B~20|) can be regarded as the definition of SST chemical potential for 
the steady state in the driven lattice gas. It is worth trying to evaluate this and other 
thermodynamic quantities explicitly. Since exact calculations are so far impossible, we 
here calculate the leading contributions in the limit of low density and high temperature. 

First by substituting the definition (jB.16|) of g(N) into the chemical potential (|B.20J1 . 
and expanding the exponential, we get 

M = t, log )tyy__A B.61 

p 1 - p 

where we noted that (r) x ) = p. In the present section we consider a uniform system on A, 
and suppress the suffixes T, E, A, and N because they are always fixed. We thus need to 
evaluate the two-point correlation function (r] x r] y ). 

We evaluate the leading nonequilibrium correction to {r) x r) y ) by using the standard 
procedure. One first notes that, for any function h(rj) of the configuration, there is an 
identity 

£>fa) E c fa - V U ' V ){Hri u ' v ) ~ h(r))} = 0, (B.62) 

which follows from the master equation (j2.2Hjl . p{rf) is the steady state distribution. We 
here set h(rf) = r\ x r\ y . We substitute the transition rate (|B.6J) into (|B.62|) and keep only 
those terms which have order p 2 . After a straightforward (but a little tedious) calculation, 

we get 

E {-<j>(P{ J x , y - J u , y + E(x 1 - ui)}) G(x, y) 

■uGA 
\u— x\=l, uj^y 
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+<f>{/3{ J u , y - J x , y + E(m - xi)}) G(u, y)} 
+ J2 {-4>(P{ J *,v ~ J^v J rE{y 1 -v 1 )}) G(x,y) 

\v— £C| =1 , V^X 

+<fr((3{J Xl v - J x , y + E( Vl - Vl )}) G(x, v)} = 0(p 3 ), (B.63) 

where G(x,y) = (r) x r) y ), and J XyV — J if \x — y\ — 1 and J xy = otherwise. Since 
Ylix ^ x = N, the two point function G(x, y) must satisfy G(x, y) = N(N — 1). This 
normalization condition and the equation (jB.63|) determines G(x,y) (to the order p 2 ). 

By using the translation invariance, we can write G(x, y) = G(x — y) + 0(p 3 ) with a 
function G(x) of x G A\{o}. Here o = (0, 0) is the origin. From (jB.63|) . we see that G(x) 
satisfies the equation 66 

- V) G{x) + c(y - aj) G(y)} = 0, (B.64) 

yeA 

|as-y|=l, y^o 

for any x G A. Here the effective transition rate is given by 

c(x ^ y) = 4>((3{J X -J y + E( Xl - yi )}) + <p(f3{J x -J y + E( Vl - Xl )}), (B.65) 

with J x = J if | a; | = 1 and J x = otherwise. 

Let us denote the unit vectors as e\ = (1,0) and e 2 = (0,1). We introduce U = 
{e±, —e±, e 2 , — e 2 }, which is the set of sites neighboring to the origin o. Now unless x or y is 
in U, we have c(a; — > y) = t = 4>(f3 E) + 0(— (3 E) if a? — y = ±ei, and c(a? — > y) = s = 20(0) 
if a? — 2/ = ±e 2 . The effective hopping rate c(x — > y) become irregular only around the 
origin. More precisely, for a? G W, we have c(a; — > x ± ei) = 0(/3{ J + -E 1 }) + </>(/?{ J — -E"}), 
c(cc ± ei ->• aj) = (f)(-f3{J + E}) + (f)(-(3{J - E}), c(x ^ x ± e 2 ) = 20(/3 J), and 
£(a;±e 2 ->aj) =2<f)(-pj). 

By explicitly separating the equilibrium behavior in G(a;), we write 

G(a ; )=G'oe /3J *(l + V 3; ), (B.66) 

where ^ is the nonequilibrium correction which vanishes if E = 0, and Go is the normal- 
ization constant. By substituting (jB.66|) into (jB.64|) . we get 

]T {-t(x - y)(l + ^) + t(y - a:)(l + i, y )} = 0, (B.67) 
yeA 

|sr— 1/|=1, y^o 

where the hopping rates are written as 

t(x^y)=t {0) (x^y) + At(x^y), (B.68) 
66 This is the same equation as one gets for the driven lattice gas with only two particles as studied in 

en 
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Figure 24: The nonequilibrium correction ifj x is the solution of the Laplace-Poisson 
equation with the charge distribution Q x . The symbols +, — represents the charge 
Qq and — Qq. Note that this is a collection of quadrupoles. 



with t (0) (a; -> x ± d) = t and t (0) (a; 
near the origin, we have, for x G U, 



x ± = s for any a? G A. As for the correction 



At(x — > x ± ei) 
At(x ± ei — >■ x) 
At(x — > x ± 
At(cc ± e 2 — > x) 



e^{0(/3{ J + E}) + 4>((3{J -E})}- {4>((3E) + <j>{-/3E)}, 
<f>{-/3{ J + E}) + <P(-(3{J - E}) - {<j>{f5E) + <K-/3E)}, 
2e /3J 0(/3J) -20(0), 

20(-/3J) -20(0), (B.69) 



and At(x — > y) = for other combinations. 

Note that At(x — > y) — > as /3 — > 0. We thus neglect the cross terms Atip in ()B.67|) 
to get the lowest order contribution for ip x in the limit of high temperature. The result is 



£ 

yeA 



\x-y\=l, y^o 



with 



Q x = {At(y^x)-At(x^y)}. 

yeA 
\x-y\=l, y^o 



(B.70) 



(B.71) 



Note that (jB.70|) is nothing but the Laplace-Poisson equation on the two-dimensional 
lattice with charge distribution Q x . 

The charge Q x can be calculated using the explicit forms (jB.69|) of At(x — > y) and 
the (local detailed balance) condition <p(h) = e~ h <p(—h), which is (I2.28|) . After a little 
calculation one finds that Q± ei = Q , Q± 2ei = -Qo, Q± e2 = 2Q , Q± ei ± e2 = Q± eiTe2 = 
—Qo, and Q x = otherwise, where 

Qo = 0(-/3{J-E}) + 0(-/3{J + E})-e /3J {0(/3{J + E}) + 0(/3{J- J E})} 

= (l-e^)0(-/3{J- J E}) + (l-e-^)0(-/3{J + E}). (B.72) 

As can be seen from Fig. |2U the charge distribution Q x is a collection of quadrupoles. 

Clearly one has Qq = if E = 0. By expanding in (3, we find that the leading behavior 
of Qo is 

P 3 



Qo = y£V(40"(O)-0(O)), 



(B.73) 
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where we assumed that 4>{h) is differentiable, and used the fact that ()2.28|) implies 0'(O) = 
-o(0)/2. 

Thus the nonequilibrium correction ip x can be obtained by solving the Laplace-Poisson 
equation (jB.70|) with the charge distribution Q x of Fig. |2U Note also that, to get the 
lowest order behavior in (3, we can set t = s = 20(0). Since the charge distribution is a 
collection of quadrupoles, the long range behavior of ip x is given by 

* M (EOLzW (B.T4, 

which is the famous l/r d long range correlation. See j2IIlinjlII2]- But we are here interested 
only in the very short range behavior, i.e., the values of ip x for x £lA. Clearly for x GW, 
the solution of (|B.70|) is given by ip x ~ const. Qo/t with positive constants. It is not an 
easy task to determine the constants, but they are certainly numerical constants (which 
do not depend on any of the model parameters) of order 1. 

We therefore conclude that the leading correction in the nearest neighbor correlation 
function is given as 

E fa^>- E (W) cq + C(4^-1)/3 3 E 2 J P 2 , (B.75) 

y;\y-x\=l y;\y-x\=l 

where (• • -) eq denotes the expectation in the corresponding equilibrium, and C is a positive 
numerical constant which does not depend on any of the model parameters (and may be 
computed numerically if necessary). 

By substituting (jB.75|) into (jB.61|) and further expanding, we finally get 

MT, E- p) ~ fj,(T, 0; p) - C(4^ - 1)/W J 2 p. (B.76) 

0(0) 



By substituting this into (jB.25|) . we get 



f(T, E; p) ~ f(T, 0; p) - ^ (4^ - l)^E 2 J 2 p 2 , (B.77) 

which is the concrete form of SST free energy for the driven lattice gas. 

One of our postulates of SST stated in section 17751 is that the free energy f(T, E; p) is 
a concave function of E, i.e., d 2 f(T,E;p)/dE 2 < 0. It is apparent from (lR77l) that the 
validity of this postulate depends crucially on the choice of the function <p{h). As for the 
most standard heat-bath rule with 4>(h) = (1 + e' 1 ) -1 , we have 0"(O) = 0, which means 
that f(T, E; p) does not satisfy the conjectured concavity. 

C The "second law" for a general time-dependent 
Markov process 

Let us state and prove the "second law" in a Markov process which was used in sec- 
tions and El 
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C.l Main results 

Let S be a finite state space, and c^ a '(s — > s') be arbitrary transition rates which ensure 
ergodicity. (See section 12.3.11 for the general setup.) By p^\s) we denote the station- 
ary distribution for the time-independent Markov process with constant transition rates 
c^ a '(s — > s'). More precisely it satisfies 

J2 {-c (a) (s - s')p^(s) +c^(s' - s)p^(s')} = 0, (C.l) 

s'e5 
( S y s ) 

for any s G 5. (See (|2.24jl .) Let us define 

^ a \s) = -\ogp^(s). (C.2) 

Fix an arbitrary differentiable function a(t) with < t < tf, and consider a time- 
dependent Markov process with the transition rates c^ a ^>'(s — > s'). The probability dis- 
tribution Pt(s) at time t satisfies the master equation 

^ftOO = E {-c (Q(t)) (^ - OPtW + c (Q{t)) (^' - s)Pt(s')}, (C3) 
s'e<s 

for any s G 5. We set the initial condition as 

Po(s)=p£ m (s). (C.4) 

We denote the average over pt(s) as (g(s)) t = J2 s es d( s ) Pt( s )- 
Then the well known "second law" is 



at \ da 



> 0. (C.5) 

a=a(t) I t 



C.2 Proof 



For completeness we prove the "second law" (jC.5|) . Although the standard proof makes 
use of relative entropy (see, for example, section 2.9 of [93J), we here present a direct proof. 

Only in the present proof, we make use of the probabilistic language and denote by 
s(t) the random variables for the present Markov process. Thus Pt(s) = Prob[s(t) = s]. 

Fix a positive integer N, and let At = U/N. Let 67 

T\s, s') = Prob[s(t) = s\s{t- At) = s'}. (C.6) 

In physicists' language, T*(s, s') is the time-evolution kernel from t — At to t, since it 
satisfies 

p t (s) = J2T t (s,s')p t „ At (s'), (C.7) 

s'es 

67 Prob[^4|B] = Prob[A and B]/Prob[B] is the conditional probability of an event A given that an event 
B is true. 
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where pt{s) is the solution of the master equation (jC3|) with an arbitrary initial condition. 
Note that 

E T *( s ' s ')p£ W V) =p£ m (s) + 0((Atf). (C.8) 
s'e<s 

For n = 0, 1, . . . , N, let t n = n At. Define a random quantity 



i pfe (tn)) («(*n)) 

By using ()C.8|) repeatedly, we find that 



«) = e in i *-('»'-,)(tf | wiiiE 



J. J. («(*n))/ \ 

sq,«i,...,sjv_ 1 GS U=l ) n=0 I s ™/ 

e n «-o ks fa) ('0 n w7 + ° ((At)2) 

si,...,sjv-i£5 I n=2 J n=l v S «/ 

E P^ } (^-i)+iVO((At) 2 ) 
l + 0(At). (CIO) 



Then since logo; < x — 1, we have (logQ) < (Q — l) = O(At). But from (jC.9j) and 
(RTH . we have 



N-l 



logg) = -E(^ +i)) («w)-^ y (^))) 

n=0 
AT-1 

+ 0((At) 2 U. fC.n; 



n=0 
AT-1 



(it \ da; 

n=0 k \ 

By letting N — ► oo, we get the desired (IC.5|) 



a=a(t„) / . 
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